Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Χάρης Καραχριστιανίδης
Steffen Nurpmeso  wrote:

> Steffen Nurpmeso wrote in
>  <20230220191015.bby4z%stef...@sdaoden.eu>:
>  |Χάρης Καραχριστιανίδης wrote in
>  | <20230220184916.javb0%haris...@otenet.gr>:
>  ||Steffen Nurpmeso  wrote:
>  | ...
>  ||>|> I installed bogofilter and put these lines in .mailrc.
>  | ...
>  ||>|> ? spamrate 1-31
>  | ...
>  ||Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \
>  ||it has to be stored localy for spam lookup.//
>  |
>  |We do download it all in order to do the spam check.
>  |(If not that would be a bug.  .. Does not seem to be one?)
> 
> 
> You can use IMAP search expressions to match for simple "shit" on
> the server, move it away, then spamrate the rest locally.
> To make local teaching easier i have
> 
>   commandalias H spamham
>   commandalias S spamspam
> 
> I almost never have to use this no more.  (Even a key-binding
> could be used today, to make it even easier!)
> 
> For example, i download my mail via SSH like this (this is v14.10
> so it will not work 1:1 on v14.9.24; on the server s-nail is
> v14.9.24, and was even older for long, no -Y..; an excerpt only):
> 
>   define load-sdaoden.eu {
>   \local set noheader
>   \!exec ssh stef...@vpn.sdaoden.eu "\
>   { \
>   { \
>   echo 'move \"@f@FedEx|lottery\" \
>   \"@OBORON|\\[SPAM|Voice Message|\
>   beloved|business|charity|dear 
> friend|darlehen|donation|\
>   
> investment|kredit|loan|payment|urgent|voicemail|\
>   
> masturb|pädophi|pedophil|porn\" \
>   
> \"@^[[:space:]]*((hello|hi|re|reply|yo):?[[:space:]]*\
> (there[[:space:]]*)?)?\$\" \
>   ~/spam.mbox';\
>   \
>   echo 'move * ~/download.mbox'; \
>   } |\
>   mail -:/ -#f %:/var/spool/mail/steffen; \
>   } >/dev/null 2>&1 &&\
>   \
>   if [ -s ~/download.mbox ]; then \
>   cat ~/download.mbox &&\
>   rm ~/download.mbox;\
>   fi\
>   " >> ~/sec.arena/mail/download
>   \fi+download
> \h
> \spamr:n
> \sea:s
> \mov ` /var/tmp/${LOGNAME}/traffic/.spam~
> \sea:n
>   }
> 
> But something similar is doable with IMAP search expressions,
> which are executed on the server.
> 
> --steffen
> |
> |Der Kragenbaer,The moon bear,
> |der holt sich munter   he cheerfully and one by one
> |einen nach dem anderen runter  wa.ks himself off
> |(By Robert Gernhardt)

Thank you, my problem is that even emails that I define as spam with spamspam 
have score 0.00 (as all other mail).. I trained bogofilyrt with about 450 
emails till now which I marked as spamham (most of then and a few as spamspam). 
Does it need more training to show ratings other than 0.00?


Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Steffen Nurpmeso
Steffen Nurpmeso wrote in
 <20230220191015.bby4z%stef...@sdaoden.eu>:
 |Χάρης Καραχριστιανίδης wrote in
 | <20230220184916.javb0%haris...@otenet.gr>:
 ||Steffen Nurpmeso  wrote:
 | ...
 ||>|> I installed bogofilter and put these lines in .mailrc.
 | ...
 ||>|> ? spamrate 1-31
 | ...
 ||Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \
 ||it has to be stored localy for spam lookup.//
 |
 |We do download it all in order to do the spam check.
 |(If not that would be a bug.  .. Does not seem to be one?)


You can use IMAP search expressions to match for simple "shit" on
the server, move it away, then spamrate the rest locally.
To make local teaching easier i have

  commandalias H spamham
  commandalias S spamspam

I almost never have to use this no more.  (Even a key-binding
could be used today, to make it even easier!)

For example, i download my mail via SSH like this (this is v14.10
so it will not work 1:1 on v14.9.24; on the server s-nail is
v14.9.24, and was even older for long, no -Y..; an excerpt only):

  define load-sdaoden.eu {
\local set noheader
\!exec ssh stef...@vpn.sdaoden.eu "\
{ \
{ \
echo 'move \"@f@FedEx|lottery\" \
\"@OBORON|\\[SPAM|Voice Message|\
beloved|business|charity|dear 
friend|darlehen|donation|\

investment|kredit|loan|payment|urgent|voicemail|\

masturb|pädophi|pedophil|porn\" \

\"@^[[:space:]]*((hello|hi|re|reply|yo):?[[:space:]]*\
  (there[[:space:]]*)?)?\$\" \
~/spam.mbox';\
\
echo 'move * ~/download.mbox'; \
} |\
mail -:/ -#f %:/var/spool/mail/steffen; \
} >/dev/null 2>&1 &&\
\
if [ -s ~/download.mbox ]; then \
cat ~/download.mbox &&\
rm ~/download.mbox;\
fi\
" >> ~/sec.arena/mail/download
\fi+download
\h
\spamr:n
\sea:s
\mov ` /var/tmp/${LOGNAME}/traffic/.spam~
\sea:n
  }

But something similar is doable with IMAP search expressions,
which are executed on the server.

--steffen
|
|Der Kragenbaer,The moon bear,
|der holt sich munter   he cheerfully and one by one
|einen nach dem anderen runter  wa.ks himself off
|(By Robert Gernhardt)


Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Steffen Nurpmeso
Χάρης Καραχριστιανίδης wrote in
 <20230220184916.javb0%haris...@otenet.gr>:
 |Steffen Nurpmeso  wrote:
 ...
 |>|> I installed bogofilter and put these lines in .mailrc.
 ...
 |>|> ? spamrate 1-31
 ...
 |Thank you! Is it a problem that I use imap? Inbox is imap. Manual says \
 |it has to be stored localy for spam lookup.//

We do download it all in order to do the spam check.
(If not that would be a bug.  .. Does not seem to be one?)

 --End of <20230220184916.javb0%haris...@otenet.gr>

--steffen
|
|Der Kragenbaer,The moon bear,
|der holt sich munter   he cheerfully and one by one
|einen nach dem anderen runter  wa.ks himself off
|(By Robert Gernhardt)


Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Χάρης Καραχριστιανίδης
Steffen Nurpmeso  wrote:

> Hello Hariskar.
> 
> Χάρης Καραχριστιανίδης wrote in
>  <20230220150942.kdkma%haris...@otenet.gr>:
>  |Χάρης Καραχριστιανίδης  wrote:
>  |
>  |> I installed bogofilter and put these lines in .mailrc.
>  |> set spam-interface=filter
>  |> set spam-maxsize=50
>  |> set spamfilter-ham="bogofilter -n"
>  |> set spamfilter-noham="bogofilter -N"
>  |> set spamfilter-nospam="bogofilter -S"
>  |> set spamfilter-rate="bogofilter -TTu 2>/dev/null"
>  |> set spamfilter-spam="bogofilter -s"
>  |> set spamfilter-rate-scanscore="1;^(.+)$"
> 
> This is ok.
> 
>  |> set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s'
>  |> 
>  |> With:
>  |> ? spamrate 1-31
>  |> I get
>  |> spamrate:.31  1/30 done (31/0 all/skipped)
>  |> 
>  |> and nothing changes in emails spam rate, all are 0.00.
>  |> 
>  |> If I run
>  |> ? spamspam 28
>  |> nothing changes again.
>  |> Any help please?
>  |Subject should be "bogofilter question" ...
> 
> bogofilter needs to be learned in order to be able to produce
> results.  This takes quite a while, but if i recall correctly
> results improve fast.  On the other hand some things will never
> work out.  My DB is
> 
>   #?0|kent:steffen$ ll /var/tmp/steffen/.bogofilter/wordlist.lmdb
>   -rw-r- 1 steffen steffen 498155520 Feb 20 19:36 
> /var/tmp/steffen/.bogofilter/wordlist.lmdb
> 
> but this LMDB which does not have some kind of VACUUM and
> therefore needs to be dumped / restored to get rid of cruft, i do
> that once a month.  The monthly backup is
> 
>   $ ll ~/sec.arena/backups/spam.db.zst
>   -rw-r- 1 steffen steffen 77287246 Jan 28 19:14 
> /home/steffen/sec.arena/backups/spam.db.zst
> 
> and it decompresses to a file of 255850825 bytes.
> 
> SpamAssassin may be the better option if you do not have a DB as
> it has built-in things to look out for (if i recall correctly).
> 
>  --End of <20230220150942.kdkma%haris...@otenet.gr>
> 
> --steffen
> |
> |Der Kragenbaer,The moon bear,
> |der holt sich munter   he cheerfully and one by one
> |einen nach dem anderen runter  wa.ks himself off
> |(By Robert Gernhardt)


Thank you! Is it a problem that I use imap? Inbox is imap. Manual says it has 
to be stored localy for spam lookup.//


Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Steffen Nurpmeso
Hello Hariskar.

Χάρης Καραχριστιανίδης wrote in
 <20230220150942.kdkma%haris...@otenet.gr>:
 |Χάρης Καραχριστιανίδης  wrote:
 |
 |> I installed bogofilter and put these lines in .mailrc.
 |> set spam-interface=filter
 |> set spam-maxsize=50
 |> set spamfilter-ham="bogofilter -n"
 |> set spamfilter-noham="bogofilter -N"
 |> set spamfilter-nospam="bogofilter -S"
 |> set spamfilter-rate="bogofilter -TTu 2>/dev/null"
 |> set spamfilter-spam="bogofilter -s"
 |> set spamfilter-rate-scanscore="1;^(.+)$"

This is ok.

 |> set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s'
 |> 
 |> With:
 |> ? spamrate 1-31
 |> I get
 |> spamrate:.31  1/30 done (31/0 all/skipped)
 |> 
 |> and nothing changes in emails spam rate, all are 0.00.
 |> 
 |> If I run
 |> ? spamspam 28
 |> nothing changes again.
 |> Any help please?
 |Subject should be "bogofilter question" ...

bogofilter needs to be learned in order to be able to produce
results.  This takes quite a while, but if i recall correctly
results improve fast.  On the other hand some things will never
work out.  My DB is

  #?0|kent:steffen$ ll /var/tmp/steffen/.bogofilter/wordlist.lmdb
  -rw-r- 1 steffen steffen 498155520 Feb 20 19:36 
/var/tmp/steffen/.bogofilter/wordlist.lmdb

but this LMDB which does not have some kind of VACUUM and
therefore needs to be dumped / restored to get rid of cruft, i do
that once a month.  The monthly backup is

  $ ll ~/sec.arena/backups/spam.db.zst
  -rw-r- 1 steffen steffen 77287246 Jan 28 19:14 
/home/steffen/sec.arena/backups/spam.db.zst

and it decompresses to a file of 255850825 bytes.

SpamAssassin may be the better option if you do not have a DB as
it has built-in things to look out for (if i recall correctly).

 --End of <20230220150942.kdkma%haris...@otenet.gr>

--steffen
|
|Der Kragenbaer,The moon bear,
|der holt sich munter   he cheerfully and one by one
|einen nach dem anderen runter  wa.ks himself off
|(By Robert Gernhardt)


Re: [S-mailx] bogofilter wuestion

2023-02-20 Thread Χάρης Καραχριστιανίδης
Χάρης Καραχριστιανίδης  wrote:

> I installed bogofilter and put these lines in .mailrc.
> set spam-interface=filter
> set spam-maxsize=50
> set spamfilter-ham="bogofilter -n"
> set spamfilter-noham="bogofilter -N"
> set spamfilter-nospam="bogofilter -S"
> set spamfilter-rate="bogofilter -TTu 2>/dev/null"
> set spamfilter-spam="bogofilter -s"
> set spamfilter-rate-scanscore="1;^(.+)$"
> set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s'
> 
> With:
> ? spamrate 1-31
> I get
> spamrate:.31  1/30 done (31/0 all/skipped)
> 
> and nothing changes in emails spam rate, all are 0.00.
> 
> If I run
> ? spamspam 28
> nothing changes again.
> Any help please?
Subject should be "bogofilter question" ...


[S-mailx] bogofilter wuestion

2023-02-20 Thread Χάρης Καραχριστιανίδης
I installed bogofilter and put these lines in .mailrc.
set spam-interface=filter
set spam-maxsize=50
set spamfilter-ham="bogofilter -n"
set spamfilter-noham="bogofilter -N"
set spamfilter-nospam="bogofilter -S"
set spamfilter-rate="bogofilter -TTu 2>/dev/null"
set spamfilter-spam="bogofilter -s"
set spamfilter-rate-scanscore="1;^(.+)$"
set headline='%>%a%m%$ %-18f %16d %4l/%-5o %i%-s'

With:
? spamrate 1-31
I get
spamrate:.31  1/30 done (31/0 all/skipped)

and nothing changes in emails spam rate, all are 0.00.

If I run
? spamspam 28
nothing changes again.
Any help please?