Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Artem Bokhan
I will play with ulimit (was 1024 :( ) first and wait until bots will wake up again :) May be it's possible to increase the limits by policyd instead of shell?.. Cami Sardinha ?: > Artem Bokhan wrote: > >> I'll try to change ulimit and possible MAXFD. >> But it's still bad that policyd nee

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Cami Sardinha
Artem Bokhan wrote: > I'll try to change ulimit and possible MAXFD. > But it's still bad that policyd needs to be restarted after it reaches > limit. Artem, Please downgrade to v1.80 and check/test if this still occurs. Nigel, can you dig into this further? - r5 | nkukard | 2007-06-20 19:48:0

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Tobias J. Kreidl
Sounds like recompiling with a larger number of file descriptors and then running with a bigger limit/ulimit might do the trick. In any case, the number of concurrent policyd file handles shouldn't be less than the number of postfix instances on any given machine. On Fri, 7 Sep 2007, Artem Bokhan

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Artem Bokhan
As I said, I don't have any bottlenecks with system resources. Tobias J. Kreidl ?: > Is policyd on the same machine as the DB server? If so, you may want to > have your mySQL server on a different machine. If not, it sounds like you > might have to spit your load among more than one mail

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Artem Bokhan
> Frankly, I think you'd have to have a pretty hefty amount of processing > to run that many email connections plus policyd plus whatever else might > be running on your mail server (amavisd, spamassassin, etc.) to sustain > that kind of > load. I have two MXes with 4 cores of Xeon 5130 (2.0

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Artem Bokhan
I'll try to change ulimit and possible MAXFD. But it's still bad that policyd needs to be restarted after it reaches limit. Cami Sardinha ?: > Tobias J. Kreidl wrote: > >> So, in the case of 5k connections per minute, the server is probably >> saturated... does policyd log that it's reach

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Artem Bokhan
Do you only have 1 machine as your MX? I have two MXes each running its own policyd. Do you run Policyd on the same server as your MySQL database? Mysqld located on first MX. How many concurrent smtpd processes do you have on your MX? Up to 1.5k per MX in peak during bot attacks. I

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Tobias Kreidl
Cami Sardinha wrote: > Tobias J. Kreidl wrote: > >> So, in the case of 5k connections per minute, the server is probably >> saturated... does policyd log that it's reached its limit? >> > > Connections per minute do not mean much. Concurrent connections > is what matters. It should log when

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Cami Sardinha
Tobias J. Kreidl wrote: > So, in the case of 5k connections per minute, the server is probably > saturated... does policyd log that it's reached its limit? Connections per minute do not mean much. Concurrent connections is what matters. It should log when its limit has been reached. > If more con

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Tobias J. Kreidl
So, in the case of 5k connections per minute, the server is probably saturated... does policyd log that it's reached its limit? If more connections are needed, one would of course have to increase the file descriptor limit and recompile policyd according to MAXFDS in policyd.h. On Thu, 6 Sep 20

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Cami Sardinha
Tobias J. Kreidl wrote: > Where is the maximum number of concurrent policyd processes defined? > Is it defined/restricted by the limit of file descriptors? Correct. Depending on your OS, ulimit -n will show the limit and starting Policyd up in DEBUG=3 mode will show if its managed to override that

Re: [policyd-users] policyd under high load and select()

2007-09-06 Thread Tobias J. Kreidl
Where is the maximum number of concurrent policyd processes defined? Is it defined/restricted by the limit of file descriptors? - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems