Re: spamassassin slow to process messages

2003-07-07 Thread Dan Nelson
In the last episode (Jul 08), Daniel Bye said:
> On Tue, Jul 08, 2003 at 09:57:14AM +1000, Andrew Thomson wrote:
> > we're back in business...
> > 
> > Jul  8 09:50:11 athomson spamd[52899]: clean message (0.4/5.0) for ajt:1001 in 
> > 10.2 seconds, 3044 bytes. 
> > Jul  8 09:50:28 athomson spamd[52912]: clean message (0.4/5.0) for ajt:1001 in 
> > 10.3 seconds, 5840 bytes. 
> > Jul  8 09:54:35 athomson spamd[52952]: clean message (0.4/5.0) for ajt:1001 in 0.3 
> > seconds, 3027 bytes. 
> > Jul  8 09:54:43 athomson spamd[52965]: clean message (1.3/5.0) for ajt:1001 in 0.4 
> > seconds, 8524 bytes. 
> > 
> > put
> > use_razor1 0
> > use_razor2 0
> > in my local config and now it goes real fast!!
> > 
> > so what is this razor business anyway??
> 
> It's a collaborative database of ...  Heck, it'll be easier if you take a
> look at the web site.  All I will say is that Razor, pyzor and dcc are all
> really good resources for culling spam.

You might want to turn debugging up and find out why razor is timing
out instead of returning results (the default razor_timeout is 10).  It
really does do a good job.

-- 
Dan Nelson
[EMAIL PROTECTED]
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: spamassassin slow to process messages

2003-07-07 Thread Daniel Bye
On Tue, Jul 08, 2003 at 09:57:14AM +1000, Andrew Thomson wrote:
> we're back in business...
> 
> Jul  8 09:50:11 athomson spamd[52899]: clean message (0.4/5.0) for
> ajt:1001 in 10.2 seconds, 3044 bytes. 
> Jul  8 09:50:28 athomson spamd[52912]: clean message (0.4/5.0) for
> ajt:1001 in 10.3 seconds, 5840 bytes. 
> Jul  8 09:54:35 athomson spamd[52952]: clean message (0.4/5.0) for
> ajt:1001 in 0.3 seconds, 3027 bytes. 
> Jul  8 09:54:43 athomson spamd[52965]: clean message (1.3/5.0) for
> ajt:1001 in 0.4 seconds, 8524 bytes. 
> 
> put
> use_razor1 0
> use_razor2 0
> in my local config and now it goes real fast!!
> 
> thanks for the tips..
> 
> so what is this razor business anyway??

It's a collaborative database of ...  Heck, it'll be easier if you take a
look at the web site.  All I will say is that Razor, pyzor and dcc are all
really good resources for culling spam.

http://razor.sourceforge.net
http://pyzor.sourceforge.net
http://www.rhyolite.com/anti-spam/dcc/

HTH,

Dan

-- 
Daniel Bye

PGP Key: ftp://ftp.slightlystrange.org/pgpkey/dan.asc
PGP Key fingerprint: 3B9D 8BBB EB03 BA83 5DB4 3B88 86FC F03A 90A1 BE8F
 _
  ASCII ribbon campaign ( )
 - against HTML, vCards and  X
- proprietary attachments in e-mail / \


pgp0.pgp
Description: PGP signature


Re: spamassassin slow to process messages

2003-07-07 Thread Andrew Thomson
On Tue, 2003-07-08 at 09:37, Matthew Hunt wrote:
> On Tue, Jul 08, 2003 at 09:08:37AM +1000, Andrew Thomson wrote:
> 
> > I've got a CPU: Pentium III/Pentium III Xeon/Celeron (930.32-MHz
> > 686-class CPU) and I'm seeing performance like,
> > 
> > Jul  8 08:25:11 athomson spamd[52016]: clean message (0.4/5.0) for
> > ajt:1001 in 10.2 seconds, 2132 bytes. 
> 
> Well, that's pretty bad.  I see:
> 
> Jul  7 04:05:49 wopr spamd[66708]: identified spam (8.4/5.0) for mph:501 in 4.0 
> seconds, 1206 bytes. 
> Jul  7 04:08:18 wopr spamd[66726]: clean message (-5.3/5.0) for mph:501 in 7.1 
> seconds, 2553 bytes. 
> 
> This is on a Cyrix 6x86 (166 MHz 486-class CPU) with no L2 cache.  :-)
> 
> Is the machine heavily loaded with other work?  Assuming that there are
> no messages between the ones you posted, it doesn't look like the machine
> is overburdened by mail alone.

we're back in business...

Jul  8 09:50:11 athomson spamd[52899]: clean message (0.4/5.0) for
ajt:1001 in 10.2 seconds, 3044 bytes. 
Jul  8 09:50:28 athomson spamd[52912]: clean message (0.4/5.0) for
ajt:1001 in 10.3 seconds, 5840 bytes. 
Jul  8 09:54:35 athomson spamd[52952]: clean message (0.4/5.0) for
ajt:1001 in 0.3 seconds, 3027 bytes. 
Jul  8 09:54:43 athomson spamd[52965]: clean message (1.3/5.0) for
ajt:1001 in 0.4 seconds, 8524 bytes. 

put
use_razor1 0
use_razor2 0
in my local config and now it goes real fast!!

thanks for the tips..

so what is this razor business anyway??

ajt.


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: spamassassin slow to process messages

2003-07-07 Thread Andrew Thomson
On Tue, 2003-07-08 at 09:22, Daniel Bye wrote:
> Could be mx timeouts, DNS timeouts, rbl timeouts, dcc/razor/pyzor
> timeouts...
> 
> In your global SpamAssassin config, try setting a value for timelog_path -
> this will cause spamd to log what it's doing, and where it spent most time
> doing it.  Check perldoc Mail::SpamAssassin::Conf.
> 
> You might also try turning on debugging (modify /usr/local/etc/rc.d/spamd.sh
> so that spamd is called with the `-D' option, then restart spamd).  You will
> then get lots of debugging in /var/log/mail.

Thanks Dan.

Some great suggestions, appreciate it. Anyway you were onto it.. tracked
down the following..

0.000: Finished head tests (Delta: 0.000s)
0.000: Starting body tests
0.000: Razor2 -> Starting razor test (10 secs max)
10.000: Razor2 -> Finished razor test: not known spam (Delta: 10.000s)
10.000: Finished body tests (Delta: 10.000s)

Time to investigate that.

cheers,

ajt.


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: spamassassin slow to process messages

2003-07-07 Thread Matthew Hunt
On Tue, Jul 08, 2003 at 09:08:37AM +1000, Andrew Thomson wrote:

> I've got a CPU: Pentium III/Pentium III Xeon/Celeron (930.32-MHz
> 686-class CPU) and I'm seeing performance like,
> 
> Jul  8 08:25:11 athomson spamd[52016]: clean message (0.4/5.0) for
> ajt:1001 in 10.2 seconds, 2132 bytes. 

Well, that's pretty bad.  I see:

Jul  7 04:05:49 wopr spamd[66708]: identified spam (8.4/5.0) for mph:501 in 4.0 
seconds, 1206 bytes. 
Jul  7 04:08:18 wopr spamd[66726]: clean message (-5.3/5.0) for mph:501 in 7.1 
seconds, 2553 bytes. 

This is on a Cyrix 6x86 (166 MHz 486-class CPU) with no L2 cache.  :-)

Is the machine heavily loaded with other work?  Assuming that there are
no messages between the ones you posted, it doesn't look like the machine
is overburdened by mail alone.

-- 
Matthew Hunt <[EMAIL PROTECTED]> * Science rules.
http://www.pobox.com/~mph/   *
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: spamassassin slow to process messages

2003-07-07 Thread Daniel Bye
On Tue, Jul 08, 2003 at 09:08:37AM +1000, Andrew Thomson wrote:
> I'm looking for some suggestions as to why my spamassassin is so slow!
> 
> Installed from ports.
> 
> Details:
> 
> p5-Mail-SpamAssassin-2.55
> 5.0-RELEASE-p7
> 
> I'm running spamd and using spamc/procmail to pass the messages to
> spamd.
> 
> I was reading the following,
> 
> http://spamassassin.rediris.es/dist/spamd/README.spamd
> 
> and it was talking with figures like:
> 
> "Well, on my 400MHz K6-2 mail server, spamassassin process a 11689 byte
> message in about 3.36 seconds, spamc/spamd processes the same message in
> about 0.86 seconds, or about 4 times faster."
> 
> I've got a CPU: Pentium III/Pentium III Xeon/Celeron (930.32-MHz
> 686-class CPU) and I'm seeing performance like,
> 
> Jul  8 08:25:11 athomson spamd[52016]: clean message (0.4/5.0) for
> ajt:1001 in 10.2 seconds, 2132 bytes. 
> Jul  8 08:25:27 athomson spamd[52031]: clean message (0.4/5.0) for
> ajt:1001 in 10.2 seconds, 2092 bytes. 
> Jul  8 08:30:12 athomson spamd[52074]: identified spam (16.0/5.0) for
> ajt:1001 in 10.3 seconds, 3158 bytes. 
> Jul  8 08:30:28 athomson spamd[52093]: clean message (-2.1/5.0) for
> ajt:1001 in 10.2 seconds, 2847 bytes. 
> Jul  8 08:30:44 athomson spamd[52100]: clean message (0.4/5.0) for
> ajt:1001 in 10.2 seconds, 2133 bytes. 
> 
> Much smaller messages, taking much longer to process!!

Could be mx timeouts, DNS timeouts, rbl timeouts, dcc/razor/pyzor
timeouts...

In your global SpamAssassin config, try setting a value for timelog_path -
this will cause spamd to log what it's doing, and where it spent most time
doing it.  Check perldoc Mail::SpamAssassin::Conf.

You might also try turning on debugging (modify /usr/local/etc/rc.d/spamd.sh
so that spamd is called with the `-D' option, then restart spamd).  You will
then get lots of debugging in /var/log/mail.

HTH

Dan

-- 
Daniel Bye

PGP Key: ftp://ftp.slightlystrange.org/pgpkey/dan.asc
PGP Key fingerprint: 3B9D 8BBB EB03 BA83 5DB4 3B88 86FC F03A 90A1 BE8F
 _
  ASCII ribbon campaign ( )
 - against HTML, vCards and  X
- proprietary attachments in e-mail / \


pgp0.pgp
Description: PGP signature


spamassassin slow to process messages

2003-07-07 Thread Andrew Thomson
I'm looking for some suggestions as to why my spamassassin is so slow!

Installed from ports.

Details:

p5-Mail-SpamAssassin-2.55
5.0-RELEASE-p7

I'm running spamd and using spamc/procmail to pass the messages to
spamd.

I was reading the following,

http://spamassassin.rediris.es/dist/spamd/README.spamd

and it was talking with figures like:

"Well, on my 400MHz K6-2 mail server, spamassassin process a 11689 byte
message in about 3.36 seconds, spamc/spamd processes the same message in
about 0.86 seconds, or about 4 times faster."

I've got a CPU: Pentium III/Pentium III Xeon/Celeron (930.32-MHz
686-class CPU) and I'm seeing performance like,

Jul  8 08:25:11 athomson spamd[52016]: clean message (0.4/5.0) for
ajt:1001 in 10.2 seconds, 2132 bytes. 
Jul  8 08:25:27 athomson spamd[52031]: clean message (0.4/5.0) for
ajt:1001 in 10.2 seconds, 2092 bytes. 
Jul  8 08:30:12 athomson spamd[52074]: identified spam (16.0/5.0) for
ajt:1001 in 10.3 seconds, 3158 bytes. 
Jul  8 08:30:28 athomson spamd[52093]: clean message (-2.1/5.0) for
ajt:1001 in 10.2 seconds, 2847 bytes. 
Jul  8 08:30:44 athomson spamd[52100]: clean message (0.4/5.0) for
ajt:1001 in 10.2 seconds, 2133 bytes. 

Much smaller messages, taking much longer to process!!

ajt.



___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"