Re: [S-mailx] bogofilter wuestion
Steffen Nurpmeso wrote in <20230221173236.ulzv1%stef...@sdaoden.eu>: |Χάρης Καραχριστιανίδης wrote in | <20230221033050.uf_w5%haris...@otenet.gr>: | ... ||Thank you, my problem is that even emails that I define as spam with \ ||spamspam have score 0.00 (as all other mail).. I trained bogofilyrt \ ||with about 450 emails till now which I marked as spamham (most of then \ ||and a few as spamspam). Does it need more training to show ratings \ ||other than 0.00? | |Then yes. :-) The thing is Bayes counts words. It is pretty primitive. And usually nothing is wrong with words like mastu***tion or such, in fact it is pretty natural for at least the human species, but in some context it may be (super annoying or disgusting) spam. This is in fact why i removed the Heirloom spam code, even though it has its merits (word anonymization for example). Because now you can use whatever you want, and exchange the DBs that were trained over a long time in between whoever needs a trained Bayes spam checker. In real life i expect noone except myself to use this MUA alone. (Some old hands keep using Heirloom though; one aspect could surely be that they loose a trained Bayes.) Ciao, Hariskar! --steffen | |Der Kragenbaer,The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
Re: [S-mailx] bogofilter wuestion
Χάρης Καραχριστιανίδης wrote in <20230221033050.uf_w5%haris...@otenet.gr>: ... |Thank you, my problem is that even emails that I define as spam with \ |spamspam have score 0.00 (as all other mail).. I trained bogofilyrt \ |with about 450 emails till now which I marked as spamham (most of then \ |and a few as spamspam). Does it need more training to show ratings \ |other than 0.00? Then yes. :-) --End of <20230221033050.uf_w5%haris...@otenet.gr> --steffen | |Der Kragenbaer,The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
Re: [S-mailx] bogofilter wuestion
Steffen Nurpmeso wrote: > Steffen Nurpmeso wrote in > <20230220191015.bby4z%stef...@sdaoden.eu>: > |Χάρης Καραχριστιανίδης wrote in > | <20230220184916.javb0%haris...@otenet.gr>: > ||Steffen Nurpmeso wrote: > | ... > ||>|> I installed bogofilter and put these lines in .mailrc. > | ... > ||>|> ? spamrate 1-31 > | ... > ||Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \ > ||it has to be stored localy for spam lookup.// > | > |We do download it all in order to do the spam check. > |(If not that would be a bug. .. Does not seem to be one?) > > > You can use IMAP search expressions to match for simple "shit" on > the server, move it away, then spamrate the rest locally. > To make local teaching easier i have > > commandalias H spamham > commandalias S spamspam > > I almost never have to use this no more. (Even a key-binding > could be used today, to make it even easier!) > > For example, i download my mail via SSH like this (this is v14.10 > so it will not work 1:1 on v14.9.24; on the server s-nail is > v14.9.24, and was even older for long, no -Y..; an excerpt only): > > define load-sdaoden.eu { > \local set noheader > \!exec ssh stef...@vpn.sdaoden.eu "\ > { \ > { \ > echo 'move \"@f@FedEx|lottery\" \ > \"@OBORON|\\[SPAM|Voice Message|\ > beloved|business|charity|dear > friend|darlehen|donation|\ > > investment|kredit|loan|payment|urgent|voicemail|\ > > masturb|pädophi|pedophil|porn\" \ > > \"@^[[:space:]]*((hello|hi|re|reply|yo):?[[:space:]]*\ > (there[[:space:]]*)?)?\$\" \ > ~/spam.mbox';\ > \ > echo 'move * ~/download.mbox'; \ > } |\ > mail -:/ -#f %:/var/spool/mail/steffen; \ > } >/dev/null 2>&1 &&\ > \ > if [ -s ~/download.mbox ]; then \ > cat ~/download.mbox &&\ > rm ~/download.mbox;\ > fi\ > " >> ~/sec.arena/mail/download > \fi+download > \h > \spamr:n > \sea:s > \mov ` /var/tmp/${LOGNAME}/traffic/.spam~ > \sea:n > } > > But something similar is doable with IMAP search expressions, > which are executed on the server. > > --steffen > | > |Der Kragenbaer,The moon bear, > |der holt sich munter he cheerfully and one by one > |einen nach dem anderen runter wa.ks himself off > |(By Robert Gernhardt) Thank you, my problem is that even emails that I define as spam with spamspam have score 0.00 (as all other mail).. I trained bogofilyrt with about 450 emails till now which I marked as spamham (most of then and a few as spamspam). Does it need more training to show ratings other than 0.00?
Re: [S-mailx] bogofilter wuestion
Steffen Nurpmeso wrote in <20230220191015.bby4z%stef...@sdaoden.eu>: |Χάρης Καραχριστιανίδης wrote in | <20230220184916.javb0%haris...@otenet.gr>: ||Steffen Nurpmeso wrote: | ... ||>|> I installed bogofilter and put these lines in .mailrc. | ... ||>|> ? spamrate 1-31 | ... ||Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \ ||it has to be stored localy for spam lookup.// | |We do download it all in order to do the spam check. |(If not that would be a bug. .. Does not seem to be one?) You can use IMAP search expressions to match for simple "shit" on the server, move it away, then spamrate the rest locally. To make local teaching easier i have commandalias H spamham commandalias S spamspam I almost never have to use this no more. (Even a key-binding could be used today, to make it even easier!) For example, i download my mail via SSH like this (this is v14.10 so it will not work 1:1 on v14.9.24; on the server s-nail is v14.9.24, and was even older for long, no -Y..; an excerpt only): define load-sdaoden.eu { \local set noheader \!exec ssh stef...@vpn.sdaoden.eu "\ { \ { \ echo 'move \"@f@FedEx|lottery\" \ \"@OBORON|\\[SPAM|Voice Message|\ beloved|business|charity|dear friend|darlehen|donation|\ investment|kredit|loan|payment|urgent|voicemail|\ masturb|pädophi|pedophil|porn\" \ \"@^[[:space:]]*((hello|hi|re|reply|yo):?[[:space:]]*\ (there[[:space:]]*)?)?\$\" \ ~/spam.mbox';\ \ echo 'move * ~/download.mbox'; \ } |\ mail -:/ -#f %:/var/spool/mail/steffen; \ } >/dev/null 2>&1 &&\ \ if [ -s ~/download.mbox ]; then \ cat ~/download.mbox &&\ rm ~/download.mbox;\ fi\ " >> ~/sec.arena/mail/download \fi+download \h \spamr:n \sea:s \mov ` /var/tmp/${LOGNAME}/traffic/.spam~ \sea:n } But something similar is doable with IMAP search expressions, which are executed on the server. --steffen | |Der Kragenbaer,The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
Re: [S-mailx] bogofilter wuestion
Χάρης Καραχριστιανίδης wrote in <20230220184916.javb0%haris...@otenet.gr>: |Steffen Nurpmeso wrote: ... |>|> I installed bogofilter and put these lines in .mailrc. ... |>|> ? spamrate 1-31 ... |Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \ |it has to be stored localy for spam lookup.// We do download it all in order to do the spam check. (If not that would be a bug. .. Does not seem to be one?) --End of <20230220184916.javb0%haris...@otenet.gr> --steffen | |Der Kragenbaer,The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
Re: [S-mailx] bogofilter wuestion
Steffen Nurpmeso wrote: > Hello Hariskar. > > Χάρης Καραχριστιανίδης wrote in > <20230220150942.kdkma%haris...@otenet.gr>: > |Χάρης Καραχριστιανίδης wrote: > | > |> I installed bogofilter and put these lines in .mailrc. > |> set spam-interface=filter > |> set spam-maxsize=50 > |> set spamfilter-ham="bogofilter -n" > |> set spamfilter-noham="bogofilter -N" > |> set spamfilter-nospam="bogofilter -S" > |> set spamfilter-rate="bogofilter -TTu 2>/dev/null" > |> set spamfilter-spam="bogofilter -s" > |> set spamfilter-rate-scanscore="1;^(.+)$" > > This is ok. > > |> set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s' > |> > |> With: > |> ? spamrate 1-31 > |> I get > |> spamrate:.31 1/30 done (31/0 all/skipped) > |> > |> and nothing changes in emails spam rate, all are 0.00. > |> > |> If I run > |> ? spamspam 28 > |> nothing changes again. > |> Any help please? > |Subject should be "bogofilter question" ... > > bogofilter needs to be learned in order to be able to produce > results. This takes quite a while, but if i recall correctly > results improve fast. On the other hand some things will never > work out. My DB is > > #?0|kent:steffen$ ll /var/tmp/steffen/.bogofilter/wordlist.lmdb > -rw-r- 1 steffen steffen 498155520 Feb 20 19:36 > /var/tmp/steffen/.bogofilter/wordlist.lmdb > > but this LMDB which does not have some kind of VACUUM and > therefore needs to be dumped / restored to get rid of cruft, i do > that once a month. The monthly backup is > > $ ll ~/sec.arena/backups/spam.db.zst > -rw-r- 1 steffen steffen 77287246 Jan 28 19:14 > /home/steffen/sec.arena/backups/spam.db.zst > > and it decompresses to a file of 255850825 bytes. > > SpamAssassin may be the better option if you do not have a DB as > it has built-in things to look out for (if i recall correctly). > > --End of <20230220150942.kdkma%haris...@otenet.gr> > > --steffen > | > |Der Kragenbaer,The moon bear, > |der holt sich munter he cheerfully and one by one > |einen nach dem anderen runter wa.ks himself off > |(By Robert Gernhardt) Thank you! Is it a problem that I use imap? Inbox is imap. Manual says it has to be stored localy for spam lookup.//
Re: [S-mailx] bogofilter wuestion
Hello Hariskar. Χάρης Καραχριστιανίδης wrote in <20230220150942.kdkma%haris...@otenet.gr>: |Χάρης Καραχριστιανίδης wrote: | |> I installed bogofilter and put these lines in .mailrc. |> set spam-interface=filter |> set spam-maxsize=50 |> set spamfilter-ham="bogofilter -n" |> set spamfilter-noham="bogofilter -N" |> set spamfilter-nospam="bogofilter -S" |> set spamfilter-rate="bogofilter -TTu 2>/dev/null" |> set spamfilter-spam="bogofilter -s" |> set spamfilter-rate-scanscore="1;^(.+)$" This is ok. |> set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s' |> |> With: |> ? spamrate 1-31 |> I get |> spamrate:.31 1/30 done (31/0 all/skipped) |> |> and nothing changes in emails spam rate, all are 0.00. |> |> If I run |> ? spamspam 28 |> nothing changes again. |> Any help please? |Subject should be "bogofilter question" ... bogofilter needs to be learned in order to be able to produce results. This takes quite a while, but if i recall correctly results improve fast. On the other hand some things will never work out. My DB is #?0|kent:steffen$ ll /var/tmp/steffen/.bogofilter/wordlist.lmdb -rw-r- 1 steffen steffen 498155520 Feb 20 19:36 /var/tmp/steffen/.bogofilter/wordlist.lmdb but this LMDB which does not have some kind of VACUUM and therefore needs to be dumped / restored to get rid of cruft, i do that once a month. The monthly backup is $ ll ~/sec.arena/backups/spam.db.zst -rw-r- 1 steffen steffen 77287246 Jan 28 19:14 /home/steffen/sec.arena/backups/spam.db.zst and it decompresses to a file of 255850825 bytes. SpamAssassin may be the better option if you do not have a DB as it has built-in things to look out for (if i recall correctly). --End of <20230220150942.kdkma%haris...@otenet.gr> --steffen | |Der Kragenbaer,The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
Re: [S-mailx] bogofilter wuestion
Χάρης Καραχριστιανίδης wrote: > I installed bogofilter and put these lines in .mailrc. > set spam-interface=filter > set spam-maxsize=50 > set spamfilter-ham="bogofilter -n" > set spamfilter-noham="bogofilter -N" > set spamfilter-nospam="bogofilter -S" > set spamfilter-rate="bogofilter -TTu 2>/dev/null" > set spamfilter-spam="bogofilter -s" > set spamfilter-rate-scanscore="1;^(.+)$" > set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s' > > With: > ? spamrate 1-31 > I get > spamrate:.31 1/30 done (31/0 all/skipped) > > and nothing changes in emails spam rate, all are 0.00. > > If I run > ? spamspam 28 > nothing changes again. > Any help please? Subject should be "bogofilter question" ...
[S-mailx] bogofilter wuestion
I installed bogofilter and put these lines in .mailrc. set spam-interface=filter set spam-maxsize=50 set spamfilter-ham="bogofilter -n" set spamfilter-noham="bogofilter -N" set spamfilter-nospam="bogofilter -S" set spamfilter-rate="bogofilter -TTu 2>/dev/null" set spamfilter-spam="bogofilter -s" set spamfilter-rate-scanscore="1;^(.+)$" set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s' With: ? spamrate 1-31 I get spamrate:.31 1/30 done (31/0 all/skipped) and nothing changes in emails spam rate, all are 0.00. If I run ? spamspam 28 nothing changes again. Any help please?