Re: [sniffer] Possible blip?

2004-05-21 Thread Scott Fisher
2 thoughts from me: 1. Right on on the Nigerian scams, possible keeping these rules longer. As I was forwarding out a Nigerian scam to the spam mailbox, I too wondered how long the Nigerian rules were kept in play. I might also add Nigeria's twin sister the International Lottery spam and Stock

Re: [sniffer] Possible blip?

2004-05-21 Thread Matt
Scott, Regarding my Cyrillic and Chinese filters, I did a review of a full week's held spam, looking for foreign languages and patterns to tag. I found from other research that the primary Chinese characterset, GB2312, contains the Western Latin characterset, and so someone could send an

Re: [sniffer] Possible blip?

2004-05-21 Thread Scott Fisher
Interesting. Are you searching for 2 character pairs with GB2312? Scott Fisher Director of IT Farm Progress Companies [EMAIL PROTECTED] 05/21/04 01:46PM Scott, Regarding my Cyrillic and Chinese filters, I did a review of a full week's held spam, looking for foreign languages and patterns to

Re: [sniffer] OT: Language filtering in Declude, was Possible blip?

2004-05-21 Thread Matt
No, just one, but it won't score unless there is a header or body indication of the GB2312 or Windows-1251 charactersets. I'm using a combo filter in Declude where the HIGHBIT filter is non-scoring, and the CHINESE and CYRILLIC filters contain a line that says: TESTSFAILED END NOTCONTAINS

Re: [sniffer] OT: Language filtering in Declude, was Possibleblip?

2004-05-21 Thread Matt
I think you might have possibly identified the group of required characters. I'll give that a try. I'm not sure if any Cyrillic stuff has been passing through but this bears watching as well and I might have to change my list there as well. I am also tagging BIG5, however almost all spam

Re: [sniffer] OT: Language filtering in Declude, wasPossibleblip?

2004-05-21 Thread Scott Fisher
Wouldn't it be better to reverse the order? Run the subject and header tests on the majority of the mail. Then run the body with a TESTSFAILED END NOTCONTAINS CHINESE. You should end up with less body searches this way. Scott Fisher Director of IT Farm Progress Companies [EMAIL PROTECTED]

Re: [sniffer] OT: Language filtering in Declude, wasPossibleblip?

2004-05-21 Thread Matt
Not if you want to exclude certain domains from hitting individual languages. The test for HIGHBIT pre-qualifies the message, and then there are separate tests for CHINESE and CYRILLIC that can each be independently excluded. I would have to exclude both languages/charactersets if I reversed

Re: [sniffer] Possible blip?

2004-05-21 Thread Pete McNeil
At 01:42 PM 5/21/2004, you wrote: Pete, Our Hold range has returned to more normal territory on Thursday. Here's the stats from snip/ One of my thoughts regarding minimum rule strengths and grace periods is that all groups aren't necessarily the same. For instance Nigerian scams are low volume