Re: Rules published

2012-08-11 Thread John Hardin
rpora. Jari, how do your counts look? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873

Re: Rules published

2012-08-12 Thread John Hardin
On Sun, 12 Aug 2012, Kevin A. McGrail wrote: On 8/12/2012 12:34 AM, John Hardin wrote: It's still vastly underreporting my corpora. Is this what it is reporting? ls -al *jhar* | grep Aug | grep -v \~ | awk '{print $9;}' | xargs wc -l 241 ham-bb-jhardin.log

Overlap report broken?

2012-09-03 Thread John Hardin
s possible that the changes that have been made to the masscheck system may have broken this. This may even be related to the rsync permissions problem...? Something else to look into. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #1117

Re: /lib/Mail/SpamAssassin/AsyncLoop.pm line 176

2012-10-06 Thread John Hardin
so, that's not valid and might be worthy of a rule. Can you post how that hostname actually appears in the message? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4

Re: Errors while running mass-check today

2012-10-27 Thread John Hardin
appearing in spam, then they might be worthy of a rule. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79

ping benp

2012-11-07 Thread John Hardin
BenP, could you contact me directly? I have a question about a message in your masscheck corpus. Thanks! -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C

Corpus format errors

2012-11-16 Thread John Hardin
# Switches: '--reuse --cache "--cachedir=/tmpfs/aicache_nightly" "--restart=500" "ham:detect:/export/home/bbmass/uploadedcorpora/jhardin/ham/*" "--after=-15552000" "--tail=5" "spam:detect:/export/home/bbmass /uploadedcorpora/jhard

Re: Houston, ...

2012-11-21 Thread John Hardin
st of my logs spam-axb-generic 189MB spam-axb-fraud 670MB It has never earlier required this much of waiting state. I posted 12 hours ago... And usually the "green" state has been "final". The numbers are up now. 751k spam, 175k ham -- John Hardin KA7OHZ

Masscheck results ignored due to formatting errors

2012-11-22 Thread John Hardin
ort/home/corpus-rsync/corpus/spam-net-danmcdonald.log: not tagged with a revision, ignored -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822

Re: Masscheck results ignored due to formatting errors

2012-11-23 Thread John Hardin
18:03 /export/home/corpus-rsync/corpus/spam-mmiroslaw-spam.log On 11/22/2012 11:47 PM, John Hardin wrote: danmcdonald, mmiroslaw: please check your logs, they don't appear to be properly generating and are being ignored... LOG: starting rsync slow reports (15202) at Fri Nov 23 04:41:31

Re: Masscheck results ignored due to formatting errors

2012-11-23 Thread John Hardin
e localized one... -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 -

Re: Masscheck results ignored due to formatting errors

2012-11-23 Thread John Hardin
On Fri, 23 Nov 2012, John Hardin wrote: On Fri, 23 Nov 2012, Marc Andre Selig wrote: Mmiroslaw has a localized time stamp in the first line of his logs that some tool is probably misunderstanding/unable to interpret. IMHO that's a bug in either mass-check (for localizing the time

Re: [auto] mkupdate-with-scores 1

2012-11-25 Thread John Hardin
alled "swap" mounted as a real filesystem is making me twitch. Is that some sort of ramdisk? This was likely a transient problem. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E7

Re: Long running mass-check (net)

2012-12-08 Thread John Hardin
r going to make it in time. There was no additional output in the mail from cron, it was just dead slow. Are you willing to enable the HitFreqsRuleTiming and see if a particular rule stands out? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.org

Re: Long running mass-check (net)

2012-12-08 Thread John Hardin
r going to make it in time. I can't see any rule changes in SVN in the last 48 hours that would explain this. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411

Re: Long running mass-check (net)

2012-12-08 Thread John Hardin
On Sat, 8 Dec 2012, Marc Andre Selig wrote: On Sat, Dec 08, 2012 at 12:13:15PM -0800, John Hardin wrote: Are you willing to enable the HitFreqsRuleTiming and see if a particular rule stands out? Sure. Sorry if this is a dumb question, but how do I do that? I've added if [ &

Re: Long running mass-check (net)

2012-12-08 Thread John Hardin
On Sat, 8 Dec 2012, Marc Andre Selig wrote: On Sat, Dec 08, 2012 at 01:32:58PM -0800, John Hardin wrote: On Sat, 8 Dec 2012, Marc Andre Selig wrote: So how do I enable HitFreqsRuleTiming for masscheck? Guessing: I think it has to go in a .pre file, try adding it to ~/masscheckwork

Re: [auto] do-nightly-rescore-example 8

2012-12-11 Thread John Hardin
: singular - corpus, multiple - corpora) -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6

Re: [Bug 6872] Net::DNS 0.69 breaks sa-update

2012-12-12 Thread John Hardin
long runtimes? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79

Re: [Bug 6872] Net::DNS 0.69 breaks sa-update

2012-12-12 Thread John Hardin
On Wed, 12 Dec 2012, Axb wrote: On 12/12/2012 07:18 PM, Axb wrote: On 12/12/2012 07:16 PM, John Hardin wrote: > On Wed, 12 Dec 2012, bugzilla-dae...@issues.apache.org wrote: > > > Bug 6872, fix breakage introduced by my previous change - DNS replies > > with no answe

Re: [Bug 6872] Net::DNS 0.69 breaks sa-update

2012-12-12 Thread John Hardin
change checked in. Please try again. If it still misbehaves, I'd suggest a manual "svn up ; make" just to see if the masscheck scripting isn't updating the code properly for some reason, which would be a different problem. -- John Hardin KA7OHZhttp://www

Re: [Bug 6872] Net::DNS 0.69 breaks sa-update

2012-12-13 Thread John Hardin
Check was last updated in October. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822

Re: [Bug 6872] Net::DNS 0.69 breaks sa-update

2012-12-13 Thread John Hardin
On Thu, 13 Dec 2012, dar...@chaosreigns.com wrote: On 12/13, John Hardin wrote: On Thu, 13 Dec 2012, dar...@chaosreigns.com wrote: On 12/13, Kevin A. McGrail wrote: I think this is very good. We need to get masscheck unified so everyone is using the same version. Alex, did you ever get

Re: Errors during --net masscheck

2013-03-09 Thread John Hardin
x27;m sure someone here will be able to explain this in detail. It actually appears that way in the email? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C

Re: Errors during --net masscheck

2013-03-09 Thread John Hardin
On Sat, 9 Mar 2013, Marc Andre Selig wrote: Again, I think SpamAssassin should be able to handle this without flagging an error message. Agreed. In fact, errors of that nature should be exposed so that a score can be attached to them. -- John Hardin KA7OHZhttp

Please verify classification of message

2013-08-08 Thread John Hardin
HORT,__TOCC_EXISTS,__TVD_BODY,__TVD_MIME_ATT_TP,__URI_MAILTO,__URI_MAILTO,__XM_MSOE6,__XM_MS_IN_GENERAL,__XM_OUTLOOK_EXPRESS,__XPRIO time=1328426401,scantime=0,format=f,reuse=no,set=0 -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #1

Re: we need more masscheckers

2014-02-27 Thread John Hardin
multiple boxes and masscheck them in parallel - simply treat them as separate corpora with separate result sets, each box masschecking one sub-corpus and reporting results when completed. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174

Re: More services restored

2014-05-02 Thread John Hardin
older, or under my account home dir(s)? I don't recall precisely how it was set up. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76

Rule writing: new text obfuscation mechanism

2014-06-05 Thread John Hardin
_\s] Examples: Manage_advertising_preferences_here To_remove_yourself_from_this_admail,_please_do_so_here Be_removed_from_this_important_offer -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB

Re: More services restored

2014-06-13 Thread John Hardin
ing now, but I suspect you'll have to send me a new password as well. My rsync is not currently using ssh + pubkey access. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org k

Re: More services restored

2014-06-13 Thread John Hardin
received 80485 bytes 116364.15 bytes/sec total size is 132331046 speedup is 174.96 rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9] -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.org

Re: More services restored

2014-06-15 Thread John Hardin
On Sat, 14 Jun 2014, Kevin A. McGrail wrote: On 6/13/2014 8:00 PM, John Hardin wrote: On Fri, 13 Jun 2014, Kevin A. McGrail wrote: > Rsync is using a secrets file and is not tied to the system users. OK, yes, I can get in, however there are errors: sending incremental file l

Re: More services restored

2014-06-15 Thread John Hardin
On Sun, 15 Jun 2014, John Hardin wrote: On Sat, 14 Jun 2014, Kevin A. McGrail wrote: Thanks for testing this. These permissions on the server are just crap. Unraveling what they did and why is difficult when it's an anathema to me to use chmod 777 to fix things. For the time being,

Re: More services restored

2014-06-16 Thread John Hardin
On Mon, 16 Jun 2014, Kevin A. McGrail wrote: On 6/16/2014 12:22 AM, John Hardin wrote: Successful corpora upload, no errors. Thanks for the feedback! The ruleqa web page is still stale, I assume that's on the list to be repaired as well? If not, here's a reminder... :)

Re: More services restored

2014-06-16 Thread John Hardin
xpanded arguments or associated word list. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507

Re: AUTOGEN RULES

2014-07-03 Thread John Hardin
server for uploaded corpora...? Also, is the sought-fraud generator working? I'm still maintaining and uploading my corpora for that, and I get a pretty steady flow of the damned things. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic

Re: AUTOGEN RULES

2014-07-03 Thread John Hardin
On Thu, 3 Jul 2014, Axb wrote: On 07/03/2014 06:14 PM, John Hardin wrote: On Thu, 3 Jul 2014, Axb wrote: > Guys, > > I'm working on replacing the SOUGHT rule generation- Yay! > Comments, suggestions? I don't run local masschecks, I upload my (relatively s

Re: AUTOGEN RULES

2014-07-03 Thread John Hardin
On Thu, 3 Jul 2014, Kevin A. McGrail wrote: On 7/3/2014 4:19 PM, Axb wrote: On 07/03/2014 08:50 PM, Kevin A. McGrail wrote: > On 7/3/2014 2:25 PM, John Hardin wrote: > > > > What's the current channel for the SOUGHT_FRAUD rules? It seems that > > even though the

Re: [auto] do-nightly-rescore-example 9

2014-07-17 Thread John Hardin
On Thu, 17 Jul 2014, Benny Pedersen wrote: Kevin A. McGrail skrev den 2014-07-17 16:40: Still shy on Spam. i wish i could send my hand verifyed spam to help :( You can upload your spam corpora for central checking. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin

Re: [auto] do-nightly-rescore-example 9

2014-07-17 Thread John Hardin
On Thu, 17 Jul 2014, Benny Pedersen wrote: On 17. jul. 2014 17.38.30 CEST, John Hardin wrote: You can upload your spam corpora for central checking. with a rescore account ?, or how ? I'm not sure if the same account will serve for both uploading masscheck results and uploading co

ham hits for "hackd wordpress URI" rules

2014-09-06 Thread John Hardin
?mclog=ham-dwarren -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 --

Re: XPRIO_RPATH_NULL

2014-09-10 Thread John Hardin
letting me know. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 ---

Re: RPATH_NULL_CTCQ

2014-09-13 Thread John Hardin
a custom header) and your collection system would restore that as the original envelope sender after receipt for corpus analysis so that your internal trap policies don't affect the quality and accuracy of your corpora. -- John Hardin KA7OHZhttp://www.impsec.org/~jh

Re: Rules Update Activity Log?

2014-09-22 Thread John Hardin
he health of the project in general. The rules are updated nightly I checked the cron logs (which likely I am one of the few people getting) and there has been a rule update every day in September. I didn't check farther back. You might find adding a ruleset like my KAM.cf will hel

Re: Rules Update Activity Log?

2014-09-22 Thread John Hardin
On Mon, 22 Sep 2014, John Hardin wrote: Formatting error, sorry. Should be: jhardin@davinci ~/develop/spamassassin/sa-updates $ cd 1626540 jhardin@davinci ~/develop/spamassassin/sa-updates/1626540 $ tar zxvf ../1626540.tar.gz {list of rules files extracted} -- John Hardin KA7OHZ

Re: Rules Update Activity Log?

2014-09-23 Thread John Hardin
erformance against the masscheck corpora. The base rules are much more static, they generally only change for bugfixes or addition of new capabilities (like my recent commit to add more UTF-8 variants to the ReplaceTags letter tags). -- John Hardin KA7OHZhttp://www.

Re: AXB_XSA_PXYEX

2014-10-30 Thread John Hardin
? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 --- ...the Fates

Re: AXB_XSA_PXYEX

2014-10-30 Thread John Hardin
On Thu, 30 Oct 2014, John Hardin wrote: On Thu, 30 Oct 2014, Jari Fredrisson wrote: On 30.10.2014 18:27, Axb wrote: > On 10/30/2014 05:14 PM, Jari Fredrisson wrote: > > On 30.10.2014 17:00, Jari Fredrisson wrote: > > > > I can also send these specimens unaltere

Re: We have some kind of rsync problem now?

2015-11-19 Thread John Hardin
51119-r1714950-n axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+] Looks like date logic is screwy somewhere, two dates on masschecks of the same revision? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pg

Re: We have some kind of rsync problem now?

2015-11-19 Thread John Hardin
On Thu, 19 Nov 2015, Jari Fredriksson wrote: Seems that mass check has not worked for a 2 days now, and fails on the rsync request. Can't pull down anything. I just uploaded my corpora (I don't do local checks) successfully. -- John Hardin KA7OHZhttp://www.

Re: We have some kind of rsync problem now?

2015-11-19 Thread John Hardin
On Thu, 19 Nov 2015, Kevin A. McGrail wrote: On 11/19/2015 3:57 PM, John Hardin wrote: On Thu, 19 Nov 2015, Jari Fredriksson wrote: > Seems that mass check has not worked for a 2 days now, and fails on the > rsync request. Can't pull down anything. I just uploaded my corpo

Re: Rule updates are too old - 2015-12-19

2015-12-19 Thread John Hardin
hours spamassassin_role promotions validated jhardin@davinci ~/develop/spamassassin/sa-updates $ dig +short TXT 0.4.3.updates.spamassassin.org 2.3.3.updates.spamassassin.org. "1717726" Kevin, is something wedged? -- John Hardin KA7OHZhttp://www.imps

Re: Rule updates are too old - 2015-12-19

2015-12-19 Thread John Hardin
On Sat, 19 Dec 2015, John Hardin wrote: On Sat, 19 Dec 2015, dar...@chaosreigns.com wrote: SpamAssassin version 3.3.0 has not had a rule update since 2015-12-04. SpamAssassin version 3.3.1 has not had a rule update since 2015-12-04. SpamAssassin version 3.3.2 has not had a rule update

Re: [auto] do-nightly-rescore-example 9

2015-12-28 Thread John Hardin
. And the weekly was starved, so we'll be a week recovering, at least. (Thanks for reminding me of that aspect, Kevin. I'd totally forgotten.) -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impse

validity of __GATED_THROUGH_RCVD_REMOVER in dwarren corpus?

2016-01-07 Thread John Hardin
pache committer... -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79 -

Re: validity of __GATED_THROUGH_RCVD_REMOVER in dwarren corpus?

2016-01-09 Thread John Hardin
On Sat, 9 Jan 2016, Dave Warren wrote: On 2016-01-07 18:14, John Hardin wrote: Due to bug 7286, there's some suspicion of the large S/O of __GATED_THROUGH_RCVD_REMOVER, which is primarily due to dwarren's corpus. Is he subscribed to this list? Kevin, are masscheck co

Re: validity of __GATED_THROUGH_RCVD_REMOVER in dwarren corpus?

2016-01-10 Thread John Hardin
On Sat, 9 Jan 2016, John Hardin wrote: On Sat, 9 Jan 2016, Dave Warren wrote: On 2016-01-07 18:14, John Hardin wrote: > Due to bug 7286, there's some suspicion of the large S/O of > __GATED_THROUGH_RCVD_REMOVER, which is primarily due to dwarren's > corpus. > &

Re: validity of __GATED_THROUGH_RCVD_REMOVER in dwarren corpus?

2016-01-11 Thread John Hardin
ou could instead synthesize a local Received header for them instead... :) -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C

Re: validity of __GATED_THROUGH_RCVD_REMOVER in dwarren corpus?

2016-01-11 Thread John Hardin
On Mon, 11 Jan 2016, Dave Warren wrote: On 2016-01-11 08:27, John Hardin wrote: In your case that's probably safe. All of your spam hits and all but one of your ham hits are the "no Received headers at all" case. I'm not 100% sure if I am interpreting this correctly, b

Timing of corpus submission vs. update production?

2016-05-26 Thread John Hardin
le below the threshold, but checking back later showed it above the threshold. I assume this means somebody got their results in just a bit too late to be included in the update decision making process. Do we need to push the cutoff back a bit to allow more time for submissions? -- Joh

Re: [auto] do-nightly-rescore-example 6

2016-12-23 Thread John Hardin
RS FOUND: 9 (required 10) SPAM CONTRIBUTORS FOUND: 9 (required 10) Insufficient ham corpus contributors; aborting. Exit Status 6 is not zero for do-nightly-rescore-example What the heck? It doesn't seem to see my uploaded corpora now. -- John Hardin KA7OHZhttp://w

Re: [auto] do-nightly-rescore-example 6

2016-12-24 Thread John Hardin
On Sat, 24 Dec 2016, Kevin A. McGrail wrote: On 12/23/2016 11:19 AM, John Hardin wrote: What the heck? It doesn't seem to see my uploaded corpora now. You appear to have the wrong SVN revision on your logs. Timing issue or date?? That would point to SVN issues on the central mass

Re: Fwd: Re: New masscheck corpus

2017-02-09 Thread John Hardin
is tool is important and still maintained. Thanks, Dave -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6

Re: Fwd: Re: New masscheck corpus

2017-02-12 Thread John Hardin
that this tool is important and still maintained. Thanks, Dave -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6

Re: [auto] do-nightly-rescore-example 127

2017-05-16 Thread John Hardin
On Tue, 16 May 2017, UpdatesD Cron wrote: Exit Status 127 is not zero for do-nightly-rescore-example. Whoohoo! -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411

Re: [auto] do-nightly-rescore-example 127

2017-05-16 Thread John Hardin
On Tue, 16 May 2017, Dave Jones wrote: On 05/16/2017 10:07 AM, John Hardin wrote: On Tue, 16 May 2017, UpdatesD Cron wrote: > Exit Status 127 is not zero for do-nightly-rescore-example. Whoohoo! I am still working on this but hope to have it working very soon. Dave Getting an er

Re: Ruleqa masscheck so close.

2017-06-01 Thread John Hardin
How do you guarantee all the contributors can perform the checks within an hour? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76

Re: Ruleqa masscheck so close.

2017-06-01 Thread John Hardin
On Thu, 1 Jun 2017, David Jones wrote: From: John Hardin   On Thu, 1 Jun 2017, David Jones wrote: I am working pretty hard to get the ruleqa processing going again on our new server.   We are so close to having enough contributors and ham/spam to get some new rules generated: This is from

Re: Ruleqa masscheck so close.

2017-06-02 Thread John Hardin
On Fri, 2 Jun 2017, David Jones wrote: On 06/01/2017 07:52 PM, John Hardin wrote: On Thu, 1 Jun 2017, David Jones wrote: > I have not found enough details yet on the central masscheck so I have > started with getting the remote masscheck processing working first so > we c

Re: Ruleqa masscheck so close.

2017-06-09 Thread John Hardin
oes into the nightly 72_scores.cf? The masscheck score generation process. Running the "what hits" distributed part of masscheck is only part of it. There's another phase that takes that data from everybody and calculates rule scores. -- John Hardin KA7OHZht

Update tarball master copy?

2017-06-17 Thread John Hardin
With the masscheck server rebuild, this no longer works: wget "http://buildbot.spamassassin.org/updatestage/${REV}.tar.gz"; That URL 404s. Is that a detail that got overlooked in the rebuild, or is the host/path different now? -- John Hardin KA7OHZ

Re: Update tarball master copy?

2017-06-18 Thread John Hardin
On Sat, 17 Jun 2017, Dave Jones wrote: On 06/17/2017 12:08 PM, John Hardin wrote: With the masscheck server rebuild, this no longer works: wget "http://buildbot.spamassassin.org/updatestage/${REV}.tar.gz"; That URL 404s. Is that a detail that got overlooked in the rebu

Re: Ruleset updates via nightly masscheck status

2017-10-19 Thread John Hardin
On Thu, 19 Oct 2017, David Jones wrote: John Hardin said in an earlier mail: "The problem is 72_scores has explicit bad scores in it.". Is this true? If so you override some rules which do get generated in the ~56 set? I am not sure what John meant as an action item from that

Re: Ruleset updates via nightly masscheck status

2017-10-19 Thread John Hardin
t minimizes the changes needed when rule scoring is fixed. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822

Re: Is the rsync OK?

2017-11-13 Thread John Hardin
sh servers and found that some of my old private keys were no longer being accepted because DSA was deprecated (IIRC) and I had to generate new ones. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.

giovanni and llanga masschecks?

2018-05-17 Thread John Hardin
result sets are coming in so I have no idea how the cutoff would be adjusted. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507

Re: giovanni and llanga masschecks?

2018-05-17 Thread John Hardin
On Thu, 17 May 2018, Dave Jones wrote: On 05/17/2018 04:09 PM, John Hardin wrote: I notice from the RuleQA website that the masschecks from giovanni and llanga are consistently reported separately from everybody else's. I wonder whether this is affecting the quality of masscheck - is

Re: giovanni and llanga masschecks?

2018-05-22 Thread John Hardin
On Tue, 22 May 2018, Giovanni Bechis wrote: On 05/18/18 00:53, John Hardin wrote: [...] Yes, but that's not clear as to whether they are pulling the wrong rev or are just late. SVN tagged rev in nightly_mass_check:  1831759 New masscheck submission listings in the past day:   1831759

Rule not appearing in masscheck results

2018-06-10 Thread John Hardin
at their masscheck environment and see whether that rule is indeed present? Any idea why its results wouldn't be showing up on the ruleqa website? Is ruleqa perhaps having SVN issues and isn't seeing the new rule even though it is present in results? -- John Hardin KA

Re: Rule not appearing in masscheck results

2018-06-10 Thread John Hardin
On Sun, 10 Jun 2018, David Jones wrote: On 06/10/2018 02:53 PM, John Hardin wrote: Folks: I recently added a test subrule to my sandbox... (__JS_HTML_OBFU_01, see: https://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/sandbox/jhardin/20_misc_testing.cf?r1=1832875&r2=1833128&diff_

Re: giovanni and llanga masschecks?

2018-07-03 Thread John Hardin
On Tue, 22 May 2018, John Hardin wrote: On Tue, 22 May 2018, Giovanni Bechis wrote: On 05/18/18 00:53, John Hardin wrote: [...] Yes, but that's not clear as to whether they are pulling the wrong rev or are just late. SVN tagged rev in nightly_mass_check:  1831759 New masscheck submi

Re: new error "invalid check_freemail_replyto option"

2018-07-10 Thread John Hardin
;= 3.004001 ...so that it doesn't cause problems with older installs if this rule gets published. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 13

Re: new error "invalid check_freemail_replyto option"

2018-07-10 Thread John Hardin
On Tue, 10 Jul 2018, John Hardin wrote: On Tue, 10 Jul 2018, Steven Ihde wrote: Hi all, Starting Friday I noticed the mass-check is producing thousands of lines of output like this: invalid check_freemail_replyto option: Disposition-Notification-To at /dev/shm/masscheckwork

Re: new error "invalid check_freemail_replyto option"

2018-07-10 Thread John Hardin
On Tue, 10 Jul 2018, Giovanni Bechis wrote: On 07/10/18 20:37, John Hardin wrote: ...wait - it passes lint but I do get the same error in a test run: Jul 10 10:43:22.343 [13247] warn: invalid check_freemail_replyto option: Disposition-Notification-To at lib/Mail/SpamAssassin/Plugin

Re: giovanni and llanga masschecks?

2018-07-11 Thread John Hardin
On Fri, 6 Jul 2018, Tom Hendrikx wrote: On 06-07-18 16:13, Giovanni Bechis wrote: On 07/03/18 21:38, John Hardin wrote: On Tue, 22 May 2018, John Hardin wrote: On Tue, 22 May 2018, Giovanni Bechis wrote: On 05/18/18 00:53, John Hardin wrote: [...] Yes, but that's not clear

Re: slow ruleqa?

2018-09-14 Thread John Hardin
On Fri, 14 Sep 2018, Henrik Krohns wrote: Since ruleqa keeps lots of history, probably only last week should be cached? Or few days. Does anyone actually browse ruleqa? I'd keep at least one full week, preferably at least two. -- John Hardin KA7OHZhttp://www.impse

Re: Please use --after in mass-checks

2018-09-27 Thread John Hardin
ruleqa regardless. run_all_masschecks() { ### sample: single corpus ### run_masscheck single-corpus \ --after=-174182400 ham:dir:/path/to/Maildir/.Ham/ \ --after=-4838400 spam:dir:/path/to/Maildir/.Spam/ What are those values in terms of? delta seconds from now? -- John

zero-width Unicode rule ham hit in ena-week0

2018-10-05 Thread John Hardin
perly used so that I can avoid FPs in that rule... Thanks! -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507

Re: Rule updates are too old - 2018-10-26

2018-10-26 Thread John Hardin
dropping the cumulative corpora below the publication threshold. mmiroslaw, llanga: Could you check your masscheck schedules and durations again? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key

Re: Rule updates are too old - 2018-10-26

2018-10-28 Thread John Hardin
check scheduling? -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873

Re: Rule updates are too old - 2018-10-26

2018-10-28 Thread John Hardin
On Sun, 28 Oct 2018, Marcin Mirosław wrote: W dniu 2018-10-26 o 16:38, John Hardin pisze: On Fri, 26 Oct 2018, dar...@chaosreigns.com wrote: 20181025:  Spam or ham is below threshold of 150,000:  http://ruleqa.spamassassin.org/?daterev=20181025 20181025:  Spam: 96744, Ham: 376566 It looks

thendrikx corpus check

2018-11-21 Thread John Hardin
Could thendrikx get in touch with me privately? I'd like to request a corpus check. Thanks! -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76

Re: mass check hanging

2018-12-05 Thread John Hardin
ve added a test with a bad regex? Potentially, yes. I just took another look at a rule I added for eval from a list member and it has a (complex)* part - changing that to {0,x} to limit backtracking... -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@

Re: mass check hanging

2018-12-05 Thread John Hardin
On Wed, 5 Dec 2018, Jari Fredriksson wrote: It looks this now: http://snpy.in/27fice Can you post that using something that doesn't require a tool download and install? Thx. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #

Re: mass check hanging

2018-12-05 Thread John Hardin
On Wed, 5 Dec 2018, John Hardin wrote: On Wed, 5 Dec 2018, Steven Ihde wrote: My corpus is similar in size, but it hangs around 30%. I took a backtrace with gdb this morning; result below. I think it's just spinning in a regex match, but this is the first time I've looked

Re: mass check hanging

2018-12-05 Thread John Hardin
On Wed, 5 Dec 2018, Jari Fredriksson wrote: John Hardin kirjoitti 5.12.2018 kello 19.59: On Wed, 5 Dec 2018, Steven Ihde wrote: My corpus is similar in size, but it hangs around 30%. I took a backtrace with gdb this morning; result below. I think it's just spinning in a regex match

Re: mass check hanging

2018-12-05 Thread John Hardin
On Wed, 5 Dec 2018, John Hardin wrote: On Wed, 5 Dec 2018, Jari Fredriksson wrote: John Hardin kirjoitti 5.12.2018 kello 19.59: On Wed, 5 Dec 2018, Steven Ihde wrote: My corpus is similar in size, but it hangs around 30%. I took a backtrace with gdb this morning; result below. I think

Re: mass check hanging

2018-12-05 Thread John Hardin
at it is the cause... ...done. Try again if you wish. -- John Hardin KA7OHZhttp://www.impsec.org/~jhardin/ jhar...@impsec.orgFALaholic #11174 pgpk -a jhar...@impsec.org key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873

Re: mass check hanging

2018-12-05 Thread John Hardin
On Wed, 5 Dec 2018, Jari Fredriksson wrote: John Hardin kirjoitti 5.12.2018 kello 22.51: On Wed, 5 Dec 2018, Jari Fredriksson wrote: It’s running now and remains to be seen how it goes. But unfortunately the process stalled again in the end! I just runs two threads and will not end. The

Re: mass check hanging

2018-12-06 Thread John Hardin
On Thu, 6 Dec 2018, Tom Hendrikx wrote: On 05-12-18 22:03, John Hardin wrote: On Wed, 5 Dec 2018, Jari Fredriksson wrote: John Hardin kirjoitti 5.12.2018 kello 22.51: On Wed, 5 Dec 2018, Jari Fredriksson wrote: It’s running now and remains to be seen how it goes. But unfortunately the

  1   2   >