Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Bernd Probst
-Ursprüngliche Nachricht- Von: [EMAIL PROTECTED] [mailto:amavis-user- [EMAIL PROTECTED] Im Auftrag von Christian Purnomo Gesendet: Montag, 23. Juni 2008 08:45 An: amavis-user@lists.sourceforge.net Betreff: [AMaViS-user] Amavis bottleneck? Hi All We are running Postfix +

[AMaViS-user] multiple smtpd_proxy_filter

2008-06-23 Thread Martin.Nelius
Hi, I'm running a Postfix 2.4.5 an Amavisd-new 2.5.2 on OpenSuse 10.3. My setup is Postfix/Amavisd-new as mailgateway (to an internal network) with several domains. Up to now I provided same spam-handling to all domains (postfix - smtpd_proxy_filter - amavisd-new/sa = working fine). Now I

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Shelley Waltz
Leon Kolchinsky wrote: Hi All We are running Postfix + amavisd-new-2.3.3-3 in our linux mail gateway. We have been hit hard lately with SPAM and our mail queue has been growing significantly to 10,000+ mails and it takes a few hours for the queue to go down. We received 1.6million spam

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Subject: Re: [AMaViS-user] Amavis bottleneck? Date: Mon, Jun 23, 2008 at 12:46:40PM +0200 Quoting Bernd Probst ([EMAIL PROTECTED]): : Increasing the number of $max_servers should increase throughput as long as : enough memory is. Since you already set $max_servers = 25 I think you're : system is

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Subject: Re: [AMaViS-user] Amavis bottleneck? Date: Mon, Jun 23, 2008 at 09:22:06AM -0400 Quoting Shelley Waltz ([EMAIL PROTECTED]): : Adding the rbl will dramatically decrease spam from the queue. I found that : installing a caching nameserver on the postfix smtp server host improved :

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Leon Kolchinsky
: Increasing the number of $max_servers should increase throughput as long as : enough memory is. Since you already set $max_servers = 25 I think you're : system is permanently in a state of swapping. You should check memory : allocation and the average time amavis needs to check a mail. :

Re: [AMaViS-user] Amavis fails to start after RHEL5 update 2 install

2008-06-23 Thread Quanah Gibson-Mount
--On Thursday, June 19, 2008 12:25 PM +0200 Mark Martinec [EMAIL PROTECTED] wrote: Since debug mode works, it's hard to gather data on why children won't fork. Any thoughts? Was the above strace/truss collected with an -f option? If not, it should be, as apparently the problem is in a

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread MrC
We are running Postfix + amavisd-new-2.3.3-3 in our linux mail gateway. We have been hit hard lately with SPAM and our mail queue has been growing significantly to 10,000+ mails and it takes a few hours for the queue to go down. We received 1.6million spam messages last month and I believe

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Mark Martinec
Bernd Probst wrote: Increasing the number of $max_servers should increase throughput as long as enough memory is. Tha usual bottleneck when SpamAssassin is in play is the available CPU. Increasing $max_servers only increases througput up to the point where CPU is saturated. Since you already

Re: [AMaViS-user] generating p0f stats

2008-06-23 Thread Mark Martinec
Juan, BDB no env: No such file or directory No such file or directory at /usr/local/sbin/amavisd-agent line 150. exited The error is due to amavisd ignoring my $db_home setting in amavisd.conf. It also ignores the command line '-D' switch. When hardcoding amavisd-agent then it runs

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Clifton Royston
On Mon, Jun 23, 2008 at 04:45:16PM +1000, Christian Purnomo wrote: ... We were hit with 65k spam messages between the 6 hours between 00:00am 06:00am this morning, by the time business starts, the mail queue was already soaring up to around 19k around 9am. I was watching the mail queue

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Clifton Royston
On Mon, Jun 23, 2008 at 10:28:09AM -1000, Clifton Royston wrote: *Probably* you have something in the SpamAssassin or ClamAV processing phase causing the processes to bog down. (Assuming you're using ClamAV.) P.S. Two more thoughts: * I second the suggestions already posted to help identify

Re: [AMaViS-user] recipeint score or blacklist (for outbound) ?

2008-06-23 Thread Ricardo Stella
Mark Martinec wrote: Ricardo, Trying to figure out how to add something like score_sender_maps but this is to block or soft outbound email recipient addresses... IE something like the following that I can add in an file: [EMAIL PROTECTED] +15 Or otherwise, is the only way to do it via

[AMaViS-user] amavisd 2.6.0 mysql table msgs problems

2008-06-23 Thread Benny Pedersen
can one show me a working table to mysql 4.1.x and above README.sql-mysql does not work for msgs table Benny Pedersen Need more webspace ? http://www.servage.net/?coupon=cust37098 - Check out the new SourceForge.net

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Subject: Re: [AMaViS-user] Amavis bottleneck? Date: Mon, Jun 23, 2008 at 10:51:28AM -0700 Quoting MrC ([EMAIL PROTECTED]): : Are your queues filled with bounce messages because you are accepting : mail to unknown recipients? Are you rejecting unknown recipients at the : first postfix instance.

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Clifton Royston
On Tue, Jun 24, 2008 at 09:01:05AM +1000, Christian Purnomo wrote: Subject: Re: [AMaViS-user] Amavis bottleneck? Date: Mon, Jun 23, 2008 at 10:51:28AM -0700 Quoting MrC ([EMAIL PROTECTED]): : Are your queues filled with bounce messages because you are accepting : mail to unknown recipients?

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread MrC
Christian Purnomo wrote: : Are your queues filled with bounce messages because you are accepting : mail to unknown recipients? Are you rejecting unknown recipients at the : first postfix instance. HI MrC Yes, more than 50% of the emails in the queue are Non-delivery type email. This

Re: [AMaViS-user] amavisd 2.6.0 mysql table msgs problems

2008-06-23 Thread James Bourne
On Mon, 23 Jun 2008, Benny Pedersen wrote: can one show me a working table to mysql 4.1.x and above README.sql-mysql does not work for msgs table CREATE TABLE `msgs` ( `mail_id` varchar(12) NOT NULL default '', `secret_id` varchar(12) default '', `am_id` varchar(20) NOT NULL

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Thanks Clifton, I agree that we need a *way* to stop the NDR from mailer daemon, at present I have 11155 requests pending in the mail queue from Mailer Daemon. I have done some testing re option #2 below, it seems that MS Exchange 2003 does not 'reject non-existent user' upon probing hence I

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Gary V
On 6/23/08, Christian Purnomo [EMAIL PROTECTED] wrote: I have done some testing re option #2 below, it seems that MS Exchange 2003 does not 'reject non-existent user' upon probing hence I have to cross this out (unless I'm wrong on this). I tested this by doing a few test injections to the

Re: [AMaViS-user] amavisd 2.6.0 mysql table msgs problems

2008-06-23 Thread James Bourne
On Mon, 23 Jun 2008, James Bourne wrote: On Mon, 23 Jun 2008, Benny Pedersen wrote: can one show me a working table to mysql 4.1.x and above README.sql-mysql does not work for msgs table You know I just realized, this was for amavis 2.5.3 not 2.6. Sorry about that. Regards James -- James

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
HI Mark, Thanks for your very insightful reply Spot on - CPU has been relatively high when the delay happens. As per your guess, the swap is hardly used based on the following vmstat output: [EMAIL PROTECTED] /etc/postfix # vmstat 5 procs ---memory-- ---swap-- -io

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread MrC
Christian Purnomo wrote: Spot on - CPU has been relatively high when the delay happens. As per your guess, the swap is hardly used based on the following vmstat output: [EMAIL PROTECTED] /etc/postfix # vmstat 5 procs ---memory-- ---swap-- -io --system--

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Sorry, please find below the output of amavisd-agent: entropy STR 3UCi9dvCpQ sysContact STR sysDescrSTR amavisd-new-2.3.3 (20050822) sysLocation STR sysName STR mailhost.mydomain.com sysObjectID OID 1.3.6.1.4.1.15312.2.1 sysServices INT 64 sysUpTime

Re: [AMaViS-user] Amavis bottleneck?

2008-06-23 Thread Christian Purnomo
Thanks Gary, this is what I was looking for, I have little knowledge about exchange and is still in the process of learning as I go. I can get hard 5XX error on my primary domain below (mydomain1.com) and the Sender Filter seems to kick in as expected. However when I try to send a random email