It seems the updates started happening after 2am Eastern, on 2012-11-04,
which is outside the range of time I'm logging the times of the updates
with a different script.  I'm running the alert cron job at 2am, so,
I was running it too early.  I switched it to 5am, and am now logging
the times of updates up to 5am.  I'm curious what changed on 2012-11-04.
I include some of the log of update times below.


This script does two independent tests, and alerts if either of them
passes.  

One test is if there has been an update in the last day.  In this case,
that test passed, as evidenced by a lack of text similar to "SpamAssassin
version 3.3.0 has not had a rule update since 2012-12-08."

The second test is for sufficient corpora for an update to be generated.
This test failed.  This test should not fail at the same time the above
test passes.  I believe it failed because it was run too early, before all
of the corpora were uploaded that were used in the masscheck run.  And the
first test passed because it was noticing not the update that happened
today, but the update that happened yesterday.


I'm also curious if anybody has any opinions on how much I should log
update changes.  Currently, I'm doing a DNS query every five minutes from
11pm to 5am Eastern.  It seems like that load would be insignificant, and
useful information to have for figuring these things out.

Logs of update IDs:


2012-10-02-23-55 3.3.2 1392240 midnight
2012-10-03-00-00 3.3.2 1392792

2012-10-07-23-55 3.3.2 1394971 midnight
2012-10-08-00-00 3.3.2 1395248

2012-10-10-23-55 3.3.2 1395916 midnight
2012-10-11-00-00 3.3.2 1396513

(Below are all sequential, above are not.)

2012-11-01-00-55 3.3.2 1403638 1am
2012-11-01-01-00 3.3.2 1404039

2012-11-02-01-00 3.3.2 1404039 1am
2012-11-02-01-05 3.3.2 1404503

2012-11-03-00-00 3.3.2 1404503 midnight
2012-11-03-00-05 3.3.2 1404892

2012-11-03-23-55 3.3.2 1404892 midnight
2012-11-04-00-00 3.3.2 1405308

2012-11-04-01-55 3.3.2 1405308 after 2am <- What changed here?
2012-11-04-23-00 3.3.2 1405513

2012-11-05-01-55 3.3.2 1405513 after 2am
2012-11-05-23-00 3.3.2 1405711

2012-11-06-01-55 3.3.2 1405711 after 2am
2012-11-06-23-00 3.3.2 1406071

2012-11-07-01-55 3.3.2 1406071 after 2am
2012-11-07-23-00 3.3.2 1406499

2012-11-15-01-55 3.3.2 1409116 after 2am
2012-11-15-23-00 3.3.2 1409693


On 01/01, Kevin A. McGrail wrote:
> On 1/1/2013 2:00 AM, [email protected] wrote:
> >20121231:  Spam or ham is below threshold of 150,000:  
> >http://ruleqa.spamassassin.org/?daterev=20121231
> >20121231:  Spam: 145996, Ham: 176693
> This confuses me.  According to Cron, we generated update 1427053
> based on about 200K ham/spam from 19 contributors at 10:17 PM EST
> and it was loaded into DNS about 10:33 PM EST.
> 
> Can you tell me if you still see the issue?
> 
> DNS dig agrees with me:
> 
> 0.4.3.updates.spamassassin.org. 3583 IN CNAME
> 2.3.3.updates.spamassassin.org.
> 2.3.3.updates.spamassassin.org. 3583 IN TXT     "1427053"
> 
> Regards,
> KAM
> 

-- 
"If God did not exist, it would be necessary to invent him." - Voltaire
http://www.ChaosReigns.com

Reply via email to