Re: [Declude.JunkMail] Declude v3 CPU usage and processing speed

[Matt]

Quick comment about turning hyperthreading off.  I posted a graph from sometime in the last two weeks where I tested this with 2.0.6.16 and it showed that this effectively doubled my CPU utilization.  I understand that 3.x is different, but it still launches a lot of processes such as external tests and virus scanners that are primarily single-threaded.  I won't dismiss the possibility of an error on my system considering how large the difference was for the worse, but I haven't seen any claims that turning off hyperthreading produced an improvement yet, though on other applications I have definitely seen benchmarks that show measurable improvements in some cases. Matt David Barker wrote: 1. Set THREADS 200 2. Which virus scanner are you running ? and do you have PRESCAN ON in your virus.cfg 3. Try turning hyperthreading off. 4. Set WAITFORMAIL 500 5. Have you had DNS issues with decludeproc running ? Disable WINSOCKCLEANUP ON 6. Disable WAITFORTHREADS and WAITBETWEENTHREADS Let me know. David B www.declude.com -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] On Behalf Of Markus Gufler Sent: Friday, January 13, 2006 10:11 AM To: Declude.JunkMail@declude.com Subject: RE: [Declude.JunkMail] Declude v3 CPU usage and processing speed I have worked with customers with similar Dual-Xeon CPU setup and have seen processing of 1000+ emails per minute. We have two of this machines here. It has exactly the same config from the screw who hold the server in the rack up to each dot in the junkmail config file (except the license codes ;-) The first server seems processing messages faster then the second. On the second server the more I play with values the lower CPU-usage and processing goes. After each reboot of decludeproc it's going down a little bit. Neither a reboot solved the problem. When I block incomming SMTP-traffic on the second server it will process around 50 messages per minute by showing up an average CPU usage way below of 50% (currently 20%) 1. What is your THREADS in the Declude.cfg ? Everything from 5 up to 500 2. Are you running many large filters ? I've tried enabling und disabling many filters without any noticeable change. But large filters should create a large cpu-usage. 3. How many virus scanners are you running ? Usualy two but I've also disabled the second for testing without any result 4. Is hyperthreading turned ON or OFF ? Yes task manager is showing up 4 cpu's 5. Are you using any other Directives in your declude.cfg ? Beside THREADS I've currently in use WAITFORMAIL 5000 WINSOCKCLEANUP ON I've tried changing WAITFORMAIL up to 15000 ms as suggested by another v3 Admin and I've also tried adding WAITFORTHREADS 1500 WAITBETWEENTHREADS 1 With values from 150 .. 1500 and 1 .. 1000 without any noticeable change in the task manager cpu usage. The number of queue files in the proc folder is going up and down (something between 1000 and 12000 files) The server is working and delivery messages but only with 50% of his power and speed. Netstat is showing around 100 ETSABLISHED connections and around 50 in TIME_WAIT The process list in the task manager is showing up around 50 entries Markus --- [This E-mail was scanned for viruses by Declude EVA www.declude.com] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type "unsubscribe Declude.JunkMail". The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude EVA www.declude.com] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type "unsubscribe Declude.JunkMail". The archives can be found at http://www.mail-archive.com.