Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Scott
Tom: re selinux: Yes, once I discovered the fix, I considered that could have been the casue. FWIW I'm not using it and it's disabled, so it *shouldn't* hose anything. But I would not be surprised if it were the culprit. -- View this message in context: http://spamassassin.1065346.n5.nabbl

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Tom Hendrikx
xOn 11-08-17 17:05, Scott wrote: > I'm going to go back and look at my build notes but I think that directory > got created for me. It's just as possible i followed some "guide". I am > positive i did not think it up on my own LOL. I remember more than set of > instructions one with that path se

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Scott
I'm going to go back and look at my build notes but I think that directory got created for me. It's just as possible i followed some "guide". I am positive i did not think it up on my own LOL. I remember more than set of instructions one with that path setting, and it very well could be the rela

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread RW
On Fri, 11 Aug 2017 16:22:50 +0200 Matus UHLAR - fantomas wrote: > don't set the path, that way it should work OOTB. Maybe amavis is different and has it's own internl default location, but the equivalent for spamd relies on the packager giving the spamd user a unix home directory. I once saw a

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Matus UHLAR - fantomas
On 10.08.17 20:15, Scott wrote: About the only difference in my old, functioning box and this new "clean" install was the location of the bayes files. Old box: /var/spool/amavisd/.spamassassin/ New box: /etc/mail/bayes On 11.08.17 16:22, Matus UHLAR - fantomas wrote: Do did you change bayes p

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Matus UHLAR - fantomas
On 10.08.17 20:15, Scott wrote: About the only difference in my old, functioning box and this new "clean" install was the location of the bayes files. Old box: /var/spool/amavisd/.spamassassin/ New box: /etc/mail/bayes Do did you change bayes path in first place? amavis is the only one who pr

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread Scott
Yeah, i don't know who the culprit is. sa-learn always worked. autolearn did not. So far this am it's looking good. An expected spread of autolearn no, spam, and ham. Not a single unavailable. Will check this afternoon and expect to call this done. Summary for other googlers to follow. -- View

Re: Bayes auto-learn - not happening, tentative success....

2017-08-11 Thread RW
On Thu, 10 Aug 2017 20:15:48 -0700 (MST) Scott wrote: > For reasons beyond my skill set, > SA will not auto-learn to a bayes db in a folder in /etc/mail/bayes. > Regardless of wide open permissions on everything except /etc. And > the user's confirmed ability to write to the folder. But sa-lea

Re: Bayes auto-learn - not happening - tentative success

2017-08-10 Thread Scott
Aug 10, 2017; 10:15pm Scottonline Scott Re: Bayes auto-learn - not happening, tentative success Well, here's a development... About the only difference in my old, functioning box and this new "clean" install was the location of the bayes files. Old box: /var/spool/amavis

Re: Bayes auto-learn - not happening, tentative success....

2017-08-10 Thread Scott
Well, here's a development... About the only difference in my old, functioning box and this new "clean" install was the location of the bayes files. Old box: /var/spool/amavisd/.spamassassin/ New box: /etc/mail/bayes The other details that caught my attention were that on the old box, the ONL

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
Trying to check for any locking issues I ran sa-update in debug moed su amavis -c 'sa-learn -D --spam --showdots --mbox /home/mail/onespam' Appears to be creating and dropping lock files. Nothing left over after running.. Aug 10 16:48:39.109 [7524] dbg: bayes: expiry starting Aug 10 16:48:39.11

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
Scouring the differences between this and my old server I see this: Old server: -rw--- 1 amavis amavis 83472 Aug 10 15:51 bayes_journal -rw--- 1 amavis amavis 1986 Aug 10 15:51 bayes.mutex -rw--- 1 amavis amavis 328491008 Aug 10 15:51 bayes_seen -rw--- 1 amavis ama

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
> Imho You need 100 ham and 100 spam to auto learning working. Do manual learning See earlier post today. I've got it loaded up, right?: [root@tn2 mail]# su amavis -c 'sa-learn --dump magic' 0.000 0 3 0 non-token data: bayes db version 0.000 0349

Re: Bayes auto-learn - not happening

2017-08-10 Thread AM
Imho You need 100 ham and 100 spam to auto learning working. Do manual learning 08.08.2017 8:20 PM "Scott Techlist" napisaƂ(a): > Centos7 > Postfix 3.2.2 > Amavisd-new 2.11.0 > Spamassassin 3.4.0 > Site-wide configuration > > This is a new box and I've configured some conservative values for > a

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
OK, so I don't think auto-learn works on spam. What about HAM? I've raised the floor to auto-learn HAM to 1. Before anyone gives me any grief, it's just for testing. I'll rebuild the bayes db from a corpus when I get it working. So SPAM takes the 3-way patch, 3 from the header, 3 from the body

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
OK, so I don't think auto-learn works on spam. What about HAM? I've raised the floor to auto-learn HAM to 1. Before anyone gives me any grief, it's just for testing. I'll rebuild the bayes db from a corpus when I get it working. So SPAM takes the 3-way patch, 3 from the header, 3 from the body

RE: Bayes auto-learn - not happening

2017-08-10 Thread Scott Techlist
>surely, it makes no sense blow up the database with already 100% >classified samples - you even don't do that uncnditional with a >hand-trained database (at least not forever, at the begin it makes sense >to get additional tokens) I think you misunderstood my question. I meant that as I look at

RE: Bayes auto-learn - not happening

2017-08-10 Thread techlist06
>surely, it makes no sense blow up the database with already 100% >classified samples - you even don't do that uncnditional with a >hand-trained database (at least not forever, at the begin it makes sense >to get additional tokens) I think you misunderstood my question. I meant that as I look at

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
If any particular message has a * 3.5 BAYES_99 BODY: Bayes spam probability is 99 to 100% * [score: 1.] Is it safe to assume that spam or one close to it has been learned and so it would not be a candidate for auto-learn? Maybe I'm not being patient enough. -- View this mess

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
FYI, here's the verbose headers for that same one that flowed above: X-Spam-Flag: YES X-Spam-Score: 23.904 X-Spam-Level: *** X-Spam-Status: Yes, score=23.904 tag=- tag2=5 kill=6.4 tests=[BAYES_999=0.2, BAYES_99=3.5, DCC_CHECK=3.2, DIGEST_MULTIPLE=0.293, HEAD

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
Here is a debug log for one that just flowed. I don't see anything about why auto-learn was unavailable. But it shows it's talking to the db anyway I think. Is there a way to set auto_learn_force to yes? The log format makes one thing it's a global setting but all I can find it looks like a per

RE: Bayes auto-learn - not happening

2017-08-10 Thread Scott
Here's a verbose log of amavis/spamassassin processing another high score that just came through. I don't see a peep about auto-learn. But it was unavailable too. (posting via nabble, apologies if it wraps) Aug 10 11:03:39 mail2 amavis[377]: (00377-01) LMTP :10024 /var/spool/amavisd/tmp/amavis

Re: Bayes auto-learn - not happening

2017-08-10 Thread Scott
>why this? >When you run from amavisd, you only need permission for amavis user, not for >anyone. To be sure that is not the problem. I can tighten it up once working. I understand thisis what one woudl normally use if they had a multi-user enviroment. But it can't hurt the problem for testing,

Re: Bayes auto-learn - not happening

2017-08-10 Thread David Jones
On 08/10/2017 10:06 AM, techlist06 wrote: Update: Still NOT working, but I'm giving it hell trying to figure out why :) First a couple of answers to other's questions: - John, others, not an ISP, high is relative I'm sure but the volume is much higher than I can duplicate and review every flag

Re: Bayes auto-learn - not happening

2017-08-10 Thread Matus UHLAR - fantomas
On 10.08.17 10:06, techlist06 wrote: Update: Still NOT working, but I'm giving it hell trying to figure out why :) - Matus: re:" autolearn=unavailable apparently due to not accessible bayes database [due to permissions]". I hope you are right. That would make sense to me. See below please

RE: Bayes auto-learn - not happening

2017-08-10 Thread techlist06
Update: Still NOT working, but I'm giving it hell trying to figure out why :) First a couple of answers to other's questions: - John, others, not an ISP, high is relative I'm sure but the volume is much higher than I can duplicate and review every flagged message. Right now running at about 10

Re: Bayes auto-learn - not happening

2017-08-09 Thread David Jones
On 08/08/2017 08:02 PM, Ian Zimmerman wrote: On 2017-08-08 15:20, Scott wrote: Another new one big score, auto-learn disabled. This one is fairly small. X-Spam-Status: Yes, score=29.428 tag=- tag2=5 kill=6.4 tests=[DATE_IN_PAST_03_06=1.076, DCC_CHECK=3.2, DIGEST_MULTIPLE=0.001,

Re: Bayes auto-learn - not happening

2017-08-09 Thread Matus UHLAR - fantomas
On 08.08.17 14:38, Scott wrote: Brand new spam arrives. It gets autolearn=unavailable. [...] su amavis -c 'sa-learn -D --spam --showdots --max-size=600 --mbox /home/mail/twospam' Aug 8 16:35:23.567 [18045] dbg: bayes: learned '419769464db0fabb0f1220f9ae0cf12931ad7076@sa_generated', atim

Re: Bayes auto-learn - not happening

2017-08-08 Thread John Hardin
On Tue, 8 Aug 2017, Ian Zimmerman wrote: I stopped autolearning and hacked up some scripts that put duplicate of each ham message into a folder which is then processed by sa-learn from a cronjob, with sufficient delay that I can review the contents and remove any false negatives; and similarly w

Re: Bayes auto-learn - not happening

2017-08-08 Thread Ian Zimmerman
On 2017-08-08 15:20, Scott wrote: > Another new one big score, auto-learn disabled. This one is fairly small. > > X-Spam-Status: Yes, score=29.428 tag=- tag2=5 kill=6.4 > tests=[DATE_IN_PAST_03_06=1.076, DCC_CHECK=3.2, > DIGEST_MULTIPLE=0.001, > FILL_THIS_FORM=0.001, FROM_

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
Another new one big score, auto-learn disabled. This one is fairly small. X-Spam-Status: Yes, score=29.428 tag=- tag2=5 kill=6.4 tests=[DATE_IN_PAST_03_06=1.076, DCC_CHECK=3.2, DIGEST_MULTIPLE=0.001, FILL_THIS_FORM=0.001, FROM_MISSPACED=0.001, FROM_MISSP_SPF_FAIL=1,

RE: Bayes auto-learn - not happening

2017-08-08 Thread Scott Techlist
>you need to train your bayes *by hand* to start with - how do you expect >bayes classification with no hints afetr purge the database - train 200 >ham and spam mails and *after that* look further Reindl: Thanks. I want to use some auto-training with very conservative thresholds set. All of th

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
I was getting my commands missed up, been looking at this too long. When I ran su amavis -c 'spamassassin -D 2>&1 -t onespam' That caused it to LEARN the spam. Database went from not there to one learned. Auto-learn apparently. That's what it should have done when it arrived. Brand new spam

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
Benny: re tflags > tflags foo-rule-name noautolearn > and you can force autolearn based on rulename > https://lists.gt.net/spamassassin/users/184996 > there is a long thread there that explain it more >and all condition must be met for learning I read the thread. Nothing there concrete enough fo

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
Cleared the database, ran below on the same message: su amavis -c 'spamassassin -D 2>&1 -t onespam' | less I didn't see any errors obvious to me. It recreated the databases and added this message as expected. I don't know how to tell why it would not have auto-learned. Can you tell/ teach

Re: Bayes auto-learn - not happening

2017-08-08 Thread Benny Pedersen
Scott skrev den 2017-08-08 22:19: Does this one have the requisite 3-point match? I don't understand how to tell yet. spamassassin -D 2>&1 -t mail.msg | less should show why

Re: Bayes auto-learn - not happening

2017-08-08 Thread RW
On Tue, 8 Aug 2017 13:04:16 -0700 (MST) Scott wrote: > The "3 points" criteria does not apply to manually learning No it's just a sanity check to reduce mistraining. If you can, don't use autotraining at all.

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
Apologies, I meant sa-learn. Brain fart. Thanks for the clarification on the 3-point rule. I've had a bunch of them come through. They all get autolearn=no or I get a few that say "unavailable" like the sample below. I gather from trying to figure out myself that unavailable may be things alre

Re: Bayes auto-learn - not happening

2017-08-08 Thread Benny Pedersen
Scott skrev den 2017-08-08 22:06: Better, what test flags in general disable auto-learn? tflags foo-rule-name noautolearn and you can force autolearn based on rulename https://lists.gt.net/spamassassin/users/184996 there is a long thread there that explain it more and all condition must be

Re: Bayes auto-learn - not happening

2017-08-08 Thread Benny Pedersen
Scott skrev den 2017-08-08 22:04: The "3 points" criteria does not apply to manually learning via sa-update then? typo ?. sa-update does not learn, it just update rules, you meant sa-learn ? when sa-learn is used, its not autolearn, so the limits are not appled

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
> some of the listed tags have tflags that disable autolearn < there is nothing to fix here Benny: Will you elaborate for me please? So I can understand and self-help. Better, what test flags in general disable auto-learn? -- View this message in context: http://spamassassin.1065346.n5.na

Re: Bayes auto-learn - not happening

2017-08-08 Thread Scott
The "3 points" criteria does not apply to manually learning via sa-update then? -- View this message in context: http://spamassassin.1065346.n5.nabble.com/Bayes-auto-learn-not-happening-tp138065p138071.html Sent from the SpamAssassin - Users mailing list archive at Nabble.com.

Re: Bayes auto-learn - not happening

2017-08-08 Thread RW
On Tue, 8 Aug 2017 13:06:26 -0500 Scott Techlist wrote: > Centos7 > Postfix 3.2.2 > Amavisd-new 2.11.0 > Spamassassin 3.4.0 > Site-wide configuration > > This is a new box and I've configured some conservative values for > auto-learn. I've enabled it properly AFAIK, but I can't see any sign > of

Re: Bayes auto-learn - not happening

2017-08-08 Thread Benny Pedersen
Scott Techlist skrev den 2017-08-08 20:06: X-Spam-Flag: YES X-Spam-Score: 17.374 X-Spam-Level: * X-Spam-Status: Yes, score=17.374 tag=- tag2=5 kill=6.31 tests=[RCVD_IN_BRBL_LASTEXT=1.644, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_RP_RNBL=1.284, RCVD_IN_SBL_CSS=3.558