updateDNS.sh on sa-vm1.apache.org - DNS updates disabled

2017-11-17 Thread noreply

3.3.3.updates (TXT) -> \"1815556\"

File /usr/local/bin/updateDNS.disabled exists, not updating DNS.


Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/do-stable-update-with-scores force | /usr/bin/tee /usr/local/spamassassin/automc/tmp/do-stable-update-with-scores.log

2017-11-17 Thread Merijn van den Kroonenberg
> + echo ''\''Running do-nightly-rescore-example.sh ...'
[snip]

Looking at todays 72_scores.cf compared to yesterdays, it looks pretty
normal. No big score changes and the rules which are added/removed seem to
be obscure ones, or ones who flip al lot (probably right on the corpus
threshold of 0.01).

DATE_IN_FUTURE_96_Q
MONEY_FORM
MONEY_FROM_MISSP
SINGLETS_LOW_CONTRAST

Only in 2 (added in 2)
ADVANCE_FEE_5_NEW
AXB_X_FF_SEZ_S
KHOP_DYNAMIC
MONEY_BARRISTER
TAB_IN_FROM
THREAD_INDEX_HEX

Changed
ADVANCE_FEE_2_NEW_MONEY
  0.001 0.020 0.001 0.020
  0.001 0.001 0.001 0.001
ADVANCE_FEE_3_NEW
  3.001 3.467 3.001 3.467
  2.998 3.467 2.998 3.467
ADVANCE_FEE_4_NEW_MONEY
  3.099 2.596 3.099 2.596
  3.100 2.596 3.100 2.596
ADVANCE_FEE_5_NEW_FRM_MNY
  1.871 2.896 1.871 2.896
  3.399 2.896 3.399 2.896
ADVANCE_FEE_5_NEW_MONEY
  2.335 3.096 2.335 3.096
  1.885 3.096 1.885 3.096
APOSTROPHE_TOCC
  3.300 2.797 3.300 2.797
  3.105 2.796 3.105 2.796
AXB_XMAILER_MIMEOLE_OL_024C2
  1.816 0.006 1.816 0.006
  1.072 2.990 1.072 2.990
AXB_X_AOL_SEZ_S
  3.599 3.296 3.599 3.296
  3.699 3.296 3.699 3.296
BODY_URI_ONLY
  1.000 0.999 1.000 0.999
  0.999 0.999 0.999 0.999
BOGUS_MSM_HDRS
  0.795 1.377 0.795 1.377
  0.555 1.302 0.555 1.302
CK_HELO_DYNAMIC_SPLIT_IP
  1.500 0.107 1.500 0.107
  1.499 0.109 1.499 0.109
CK_HELO_GENERIC
  0.250 0.248 0.250 0.248
  0.250 0.249 0.250 0.249
DEAR_BENEFICIARY
  3.399 2.897 3.399 2.897
  3.399 2.896 3.399 2.896
FILL_THIS_FORM
  0.113 1.488 0.113 1.488
  0.001 1.340 0.001 1.340
FORM_FRAUD
  1.000 0.998 1.000 0.998
  1.000 0.999 1.000 0.999
FORM_FRAUD_3
  2.899 0.999 2.899 0.999
  2.899 1.799 2.899 1.799
FORM_FRAUD_5
  3.499 1.594 3.499 1.594
  3.499 1.850 3.499 1.850
FROM_IN_TO_AND_SUBJ
  0.001 0.001 0.001 0.001
  1.299 0.001 1.299 0.001
FROM_MISSP_DYNIP
  0.883 2.456 0.883 2.456
  1.339 2.533 1.339 2.533
FROM_MISSP_FREEMAIL
  2.213 1.781 2.213 1.781
  2.053 1.789 2.053 1.789
FROM_MISSP_MSFT
  1.097 1.596 1.097 1.596
  0.570 3.266 0.570 3.266
FROM_MISSP_REPLYTO
  2.443 0.001 2.443 0.001
  2.199 0.001 2.199 0.001
FROM_MISSP_TO_UNDISC
  1.472 0.448 1.472 0.448
  1.528 2.328 1.528 2.328
FROM_MISSP_USER
  3.316 1.188 3.316 1.188
  3.806 2.483 3.806 2.483
FROM_MISSP_XPRIO
  1.785 2.497 1.785 2.497
  1.946 2.497 1.946 2.497
FROM_WORDY
  2.500 2.498 2.500 2.498
  2.499 2.497 2.499 2.497
FSL_CTYPE_WIN1251
  3.515 3.080 3.515 3.080
  1.365 0.539 1.365 0.539
FSL_HELO_FAKE
  3.999 0.001 3.999 0.001
  4.099 0.001 4.099 0.001
FSL_MIME_NO_TEXT
  3.197 0.001 3.197 0.001
  3.238 0.001 3.238 0.001
FSL_NEW_HELO_USER
  1.719 0.750 1.719 0.750
  1.753 0.752 1.753 0.752
FUZZY_UNSUBSCRIBE
  2.884 0.001 2.884 0.001
  2.869 0.001 2.869 0.001
HELO_MISC_IP
  0.250 0.249 0.250 0.249
  0.250 0.248 0.250 0.248
HK_RANDOM_FROM
  0.999 0.999 0.999 0.999
  0.999 0.998 0.999 0.998
HK_SCAM_N2
  1.498 2.696 1.498 2.696
  0.714 2.697 0.714 2.697
IMG_DIRECT_TO_MX
  3.599 1.744 3.599 1.744
  3.499 1.743 3.499 1.743
LONG_HEX_URI
  1.102 0.853 1.102 0.853
  1.098 0.865 1.098 0.865
LONG_IMG_URI
  0.554 1.000 0.554 1.000
  0.553 1.000 0.553 1.000
MANY_PILL_PRICE
  0.001 0.395 0.001 0.395
  0.001 0.738 0.001 0.738
MILLION_USD
  2.000 1.997 2.000 1.997
  1.999 1.997 1.999 1.997
MIME_NO_TEXT
  1.803 1.997 1.803 1.997
  1.762 1.997 1.762 1.997
MONEY_ATM_CARD
  3.499 2.896 3.499 2.896
  3.600 2.896 3.600 2.896
MONEY_FRAUD_3
  3.099 0.263 3.099 0.263
  1.912 0.284 1.912 0.284
MONEY_FRAUD_8
  2.938 2.600 2.938 2.600
  0.399 2.626 0.399 2.626
NSL_RCVD_FROM_USER
  1.622 1.864 1.622 1.864
  2.812 2.669 2.812 2.669
NSL_RCVD_HELO_USER
  0.876 0.742 0.876 0.742
  0.847 2.799 0.847 2.799
PP_MIME_FAKE_ASCII_TEXT
  1.000 0.001 1.000 0.001
  0.900 0.001 0.900 0.001
RCVD_IN_MSPIKE_H2
  0.001 -1.240 0.001 -1.240
  0.001 -1.251 0.001 -1.251
RCVD_IN_MSPIKE_L4
  0.001 0.149 0.001 0.149
  0.001 0.150 0.001 0.150
RCVD_IN_MSPIKE_L5
  0.001 2.284 0.001 2.284
  0.001 2.285 0.001 2.285
SERGIO_SUBJECT_VIAGRA01
  1.022 1.670 1.022 1.670
  1.022 1.669 1.022 1.669
SHORTENED_URL_SRC
  1.800 0.001 1.800 0.001
  1.799 0.001 1.799 0.001
SPOOFED_FREEM_REPTO
  2.500 2.497 2.500 2.497
  2.499 2.497 2.499 2.497
STATIC_XPRIO_OLE
  1.999 0.638 1.999 0.638
  1.999 1.380 1.999 1.380
TO_EQ_FM_DIRECT_MX
  2.499 2.497 2.499 2.497
  2.499 2.498 2.499 2.498
TO_IN_SUBJ
  0.099 0.001 0.099 0.001
  0.100 0.001 0.100 0.001
TO_NO_BRKTS_DYNIP
  1.365 1.934 1.365 1.934
  1.362 1.933 1.362 1.933
TO_NO_BRKTS_NORDNS_HTML
  0.001 0.340 0.001 0.340
  0.001 0.338 0.001 0.338
TO_NO_BRKTS_PCNT
  2.499 2.020 2.499 2.020
  2.500 1.574 2.500 1.574
TVD_SPACE_ENCODED
  2.499 2.497 2.499 2.497
  2.499 2.498 2.499 2.498
TVD_SPACE_RATIO_MINFP
  2.500 2.497 2.500 2.497
  2.499 2.497 2.499 2.497
URI_TRY_3LD
  0.001 0.225 0.001 0.225
  0.001 0.227 0.001 0.227
URI_TRY_USME
  3.299 2.896 3.299 2.896
  3.299 2.897 3.299 2.897
URI_WP_DIRINDEX
  3.499 3.496 3.499 3.496
  3.500 3.497 3.500 3.497
URI_WP_HACKED_2
  1.488 2.497 1.488 2.497
  1.498 2.498 1.498 2.498
XPRIO
  0.536 0.140 0.536 0.140
  0.537 0.138 0.537 0.138




Re: Cron <automc@sa-vm1> ~/svn/trunk/build/mkupdates/run_nightly | /usr/bin/tee /var/www/automc.spamassassin.org/mkupdates/mkupdates.txt

2017-11-17 Thread Merijn van den Kroonenberg
Some suspicious warnings below, maybe check some time (note to self)

> + promote_active_rules
[snip]
> All tests successful.
> Files=3, Tests=6,  6 wallclock secs ( 0.02 usr  0.02 sys +  3.62 cusr
> 0.31 csys =  3.97 CPU)
> Result: PASS
> + rm rules/70_sandbox.cf rules/70_inactive.cf
> rm: cannot remove 'rules/70_inactive.cf': No such file or directory
> + svn co http://svn.apache.org/repos/asf/spamassassin/trunk/rulesrc
> svn: E155000: '/usr/local/spamassassin/automc/svn/trunk/rulesrc' is
> already a working copy for a different URL

why is rulesrc checked out separately, it should be part of the /trunk/
working copy.

> + cp -a rulesrc/scores/72_scores.cf rules/
> + rm -rf rulesrc
> + ./spamassassin --lint
> Nov 17 08:31:55.321 [8472] warn: config: could not find site rules
> directory
> ++ pwd
> + rulesdir=/usr/local/spamassassin/automc/svn/trunk/rules
> + cd /usr/local/spamassassin/automc/svn/trunk/rules
> + tar cvf - 10_default_prefs.cf 10_hasbase.cf 20_advance_fee.cf
> 20_aux_tlds.cf 20_body_tests.cf 20_compensate.cf 20_dnsbl_tests.cf
> 20_drugs.cf 20_dynrdns.cf 20_fake_helo_tests.cf 20_freemail.cf
> 20_freemail_domains.cf 20_freemail_mailcom_domains.cf 20_head_tests.cf
> 20_html_tests.cf 20_imageinfo.cf 20_mailspike.cf 20_meta_tests.cf
> 20_net_tests.cf 20_pdfinfo.cf 20_phrases.cf 20_porn.cf 20_ratware.cf
> 20_uri_tests.cf 20_vbounce.cf 23_bayes.cf 25_accessdb.cf 25_antivirus.cf
> 25_asn.cf 25_dcc.cf 25_dkim.cf 25_hashcash.cf 25_pyzor.cf 25_razor2.cf
> 25_replace.cf 25_spf.cf 25_textcat.cf 25_uribl.cf 30_text_de.cf
> 30_text_fr.cf 30_text_it.cf 30_text_nl.cf 30_text_pl.cf 30_text_pt_br.cf
> 50_scores.cf 60_adsp_override_dkim.cf 60_awl.cf 60_shortcircuit.cf
> 60_txrep.cf 60_whitelist.cf 60_whitelist_dkim.cf 60_whitelist_spf.cf
> 60_whitelist_subject.cf 72_active.cf 72_scores.cf
> 73_sandbox_manual_scores.cf local.cf regression_tests.cf
> + gzip -9
> 10_default_prefs.cf
> 10_hasbase.cf
> 20_advance_fee.cf
> 20_aux_tlds.cf
> 20_body_tests.cf
> 20_compensate.cf
> 20_dnsbl_tests.cf
> 20_drugs.cf
> 20_dynrdns.cf
> 20_fake_helo_tests.cf
> 20_freemail.cf
> 20_freemail_domains.cf
> 20_freemail_mailcom_domains.cf
> 20_head_tests.cf
> 20_html_tests.cf
> 20_imageinfo.cf
> 20_mailspike.cf
> 20_meta_tests.cf
> 20_net_tests.cf
> 20_pdfinfo.cf
> 20_phrases.cf
> 20_porn.cf
> 20_ratware.cf
> 20_uri_tests.cf
> 20_vbounce.cf
> 23_bayes.cf
> 25_accessdb.cf
> 25_antivirus.cf
> 25_asn.cf
> 25_dcc.cf
> 25_dkim.cf
> 25_hashcash.cf
> 25_pyzor.cf
> 25_razor2.cf
> 25_replace.cf
> 25_spf.cf
> 25_textcat.cf
> 25_uribl.cf
> 30_text_de.cf
> 30_text_fr.cf
> 30_text_it.cf
> 30_text_nl.cf
> 30_text_pl.cf
> 30_text_pt_br.cf
> 50_scores.cf
> 60_adsp_override_dkim.cf
> 60_awl.cf
> 60_shortcircuit.cf
> 60_txrep.cf
> 60_whitelist.cf
> 60_whitelist_dkim.cf
> 60_whitelist_spf.cf
> 60_whitelist_subject.cf
> 72_active.cf
> 72_scores.cf
> 73_sandbox_manual_scores.cf
> local.cf
> regression_tests.cf
> + '[' -s /usr/local/spamassassin/automc/tmp/stage/3.4.2/update.tgz ']'
> + linttmp=/usr/local/spamassassin/automc/tmp/stage/3.4.2/lintdir
> + rm -rf /usr/local/spamassassin/automc/tmp/stage/3.4.2/lintdir
> + mkdir /usr/local/spamassassin/automc/tmp/stage/3.4.2/lintdir
> + cd /usr/local/spamassassin/automc/tmp/stage/3.4.2/lintdir
> + gunzip -cd
> + tar xf -
> + sitetmp=/usr/local/spamassassin/automc/tmp/stage/3.4.2/sitetmp
> + rm -rf /usr/local/spamassassin/automc/tmp/stage/3.4.2/sitetmp
> + mkdir /usr/local/spamassassin/automc/tmp/stage/3.4.2/sitetmp
> + cp rules/init.pre rules/svn_only.pre rules/v310.pre rules/v312.pre
> rules/v320.pre rules/v330.pre rules/v340.pre rules/v341.pre
> /usr/local/spamassassin/automc/tmp/stage/3.4.2/sitetmp
> + ./spamassassin -x
> --configpath=/usr/local/spamassassin/automc/tmp/stage/3.4.2/lintdir
> --siteconfigpath=/usr/local/spamassassin/automc/tmp/stage/3.4.2/sitetmp -p
> /dev/null --lint
> + gpg --batch --homedir /usr/local/spamassassin/automc/key -bas
> /usr/local/spamassassin/automc/tmp/stage/3.4.2/update.tgz
> + /usr/bin/perl build/sha1sum.pl
> /usr/local/spamassassin/automc/tmp/stage/3.4.2/update.tgz
> ++ date +%Y%m%d%H%M%S
> + tagstamp=20171117083159
> +
[snip]