Re: [AMaViS-user] MANY directories in amavis/tmp
Thanks for the replies. At the moment everything is running fine and i have the time to check why this happened. And maybe allready found it. It seems like the database server (mysql) wasn't running 'normal'. Amavis reported many retries to connect over the weekend and then switched to the error: 'too many links in amavis/tmp'. So maybe amavis restartet itself and allways created new temp directories. There where no more 'dead' directories from yesterday afternoon til now. Maybe it's a goog idea to put a connection test for mysql and amavisd in our nagios. Running amavisd-new 2.4.3, btw. Postfix 2.2.9, SA 3.1.7, clamd 0.88.5. I know that the machine needs more RAM. Maybe i should have mentioned it is running in a VM-Ware Session on a DELL Server that only has 768MB at the moment. For normal operation it is running really smooth (load average between .1 and .2). Only if there is any problem and many mails are in the queue (like the 15k yesterday) it takes time to process them (took like 3 hours til the queue was down to normal). I will try to get a bit mor RAM and tune the VM Session a bit. A normal weekdays load is aroung 6 to 7k mails. Where 500 to 800 mails are clean, around 500 infected and rest blocked as spam. On weekends there is nearly no clean mail (around 50 a day), spam is the same amount and a bit more infected mail is hitting us. Thanks for the sa-bayes tip Gary, i will run 'sa-learn --force-expire' tonight. Regards / Mit freundlichen Grüßen Martin Bärtl - CDP Bharat Forge GmbH mailto: [EMAIL PROTECTED] Martin wrote: Hello, Ok, 2nd try, mail gateway is back to normal operation. I just ran into a problem cause amavis reported in the log file that there are too many links in amavis/tmp directory. Amavis didn't accept any more mails from postfix. I checked that and found around 32k directories in the format ammavisDATETTIME, all from the last 3 days. In most of them are 1 file email.txt and 1 directory parts. I moved around 3k of those directories to another place, restarted amavis and it is back working. A bit slow cause postfix has around 15k mails in the queue, but working. Now the question: can i delete those directories without losing mails? Or what do i have to do with them? http://www.ijs.si/software/amavisd/#faq-gen You really need to determine why this is happening, as it should not. What version of amavisd-new are you running? Another question regarding performance: What would be the best configuration for amavisd childs? I have mysql, postfix, clamd, amavisd, spamassassin running on this machine (P4 2800 (no HT), 384MB Ram). At the moment i have 5 processes configured but i think fewer would maybe be better cause the load average is around 3 to 4 with that many amavisd processes. As mentioned, more ram. For Spamassassin bayes storage to mysql: What housekeeping should be done to bayes_seen and bayes_tokens? Those 2 tables are getting really big (over 300k entries now). Unless you have disabled bayes_auto_expire, these files are automatically maintained. You can manually run 'sa-learn --force-expire' (as your amavis user) but sa-learn is extremely CPU intensive and will cause even more problems. For this reason, some people disable bayes_auto_expire and run 'sa-learn --force-expire' once a day in the off hours. Regards / Mit freundlichen Grüßen Martin Bärtl - CDP Bharat Forge GmbH mailto: [EMAIL PROTECTED] Gary V - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
[AMaViS-user] MANY directories in amavis/tmp
Hello, Ok, 2nd try, mail gateway is back to normal operation. I just ran into a problem cause amavis reported in the log file that there are too many links in amavis/tmp directory. Amavis didn't accept any more mails from postfix. I checked that and found around 32k directories in the format ammavisDATETTIME, all from the last 3 days. In most of them are 1 file email.txt and 1 directory parts. I moved around 3k of those directories to another place, restarted amavis and it is back working. A bit slow cause postfix has around 15k mails in the queue, but working. Now the question: can i delete those directories without losing mails? Or what do i have to do with them? Another question regarding performance: What would be the best configuration for amavisd childs? I have mysql, postfix, clamd, amavisd, spamassassin running on this machine (P4 2800 (no HT), 384MB Ram). At the moment i have 5 processes configured but i think fewer would maybe be better cause the load average is around 3 to 4 with that many amavisd processes. For Spamassassin bayes storage to mysql: What housekeeping should be done to bayes_seen and bayes_tokens? Those 2 tables are getting really big (over 300k entries now). Regards / Mit freundlichen Grüßen Martin Bärtl - CDP Bharat Forge GmbH mailto: [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
Re: [AMaViS-user] MANY directories in amavis/tmp
Bärtl schrieb: Hello, Hi! Ok, 2nd try, mail gateway is back to normal operation. I just ran into a problem cause amavis reported in the log file that there are too many links in amavis/tmp directory. Amavis didn't accept any more mails from postfix. I checked that and found around 32k directories in the format ammavisDATETTIME, all from the last 3 days. In most of them are 1 file email.txt and 1 directory parts. I moved around 3k of those directories to another place, restarted amavis and it is back working. A bit slow cause postfix has around 15k mails in the queue, but working. Now the question: can i delete those directories without losing mails? Or what do i have to do with them? Another question regarding performance: What would be the best configuration for amavisd childs? I have mysql, postfix, clamd, amavisd, spamassassin running on this machine (P4 2800 (no HT), 384MB Ram). ^^ More RAM? You could also use a ramdisk (if enough RAM is installed, depends on max. mailsize iirc: $sa_mail_body_size_limit, ...) for amavisd cause (disk) I/O is almost always slowest in the chain ... How many mails/day? At the moment i have 5 processes configured but i think fewer would maybe be better cause the load average is around 3 to 4 with that many amavisd processes. For Spamassassin bayes storage to mysql: What housekeeping should be done to bayes_seen and bayes_tokens? Those 2 tables are getting really big (over 300k entries now). Regards / Mit freundlichen Grüßen Martin Bärtl hth MH - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
Re: [AMaViS-user] MANY directories in amavis/tmp
On Mon, 2006-10-30 at 17:04 +0100, Matthias Haegele wrote: Bärtl schrieb: Hello, Another question regarding performance: What would be the best configuration for amavisd childs? I have mysql, postfix, clamd, amavisd, spamassassin running on this machine (P4 2800 (no HT), 384MB Ram). ^^ More RAM? Definitely more RAM. I've found that it works best with at least two gig. Ramp up the processes until you can run a day without swapping. You could also use a ramdisk (if enough RAM is installed, depends on max. mailsize iirc: $sa_mail_body_size_limit, ...) for amavisd cause (disk) I/O is almost always slowest in the chain ... How many mails/day? At the moment i have 5 processes configured but i think fewer would maybe be better cause the load average is around 3 to 4 with that many amavisd processes. If the load is in wait state, then you need to cur the number of processses. vmstat will give you the essential information: [EMAIL PROTECTED] ~]$ vmstat procs ---memory-- ---swap-- -io --system-- cpu r b swpd free buff cache si sobibo incs us sy id wa 1 0 193496 76396 123780 29328012 3 32 6 8 1 89 2 This box with 2 GB of ram and 32 children discards about 65000 spams a day. I should probably cut the children down some now, Greylisting has cut the number of concurrent sessions I need to maintain. -- Daniel J McDonald, CCIE # 2495, CISSP # 78281, CNX Austin Energy http://www.austinenergy.com - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
Re: [AMaViS-user] MANY directories in amavis/tmp
Martin wrote: Hello, Ok, 2nd try, mail gateway is back to normal operation. I just ran into a problem cause amavis reported in the log file that there are too many links in amavis/tmp directory. Amavis didn't accept any more mails from postfix. I checked that and found around 32k directories in the format ammavisDATETTIME, all from the last 3 days. In most of them are 1 file email.txt and 1 directory parts. I moved around 3k of those directories to another place, restarted amavis and it is back working. A bit slow cause postfix has around 15k mails in the queue, but working. Now the question: can i delete those directories without losing mails? Or what do i have to do with them? http://www.ijs.si/software/amavisd/#faq-gen You really need to determine why this is happening, as it should not. What version of amavisd-new are you running? Another question regarding performance: What would be the best configuration for amavisd childs? I have mysql, postfix, clamd, amavisd, spamassassin running on this machine (P4 2800 (no HT), 384MB Ram). At the moment i have 5 processes configured but i think fewer would maybe be better cause the load average is around 3 to 4 with that many amavisd processes. As mentioned, more ram. For Spamassassin bayes storage to mysql: What housekeeping should be done to bayes_seen and bayes_tokens? Those 2 tables are getting really big (over 300k entries now). Unless you have disabled bayes_auto_expire, these files are automatically maintained. You can manually run 'sa-learn --force-expire' (as your amavis user) but sa-learn is extremely CPU intensive and will cause even more problems. For this reason, some people disable bayes_auto_expire and run 'sa-learn --force-expire' once a day in the off hours. Regards / Mit freundlichen Grüßen Martin Bärtl - CDP Bharat Forge GmbH mailto: [EMAIL PROTECTED] Gary V - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnkkid=120709bid=263057dat=121642 ___ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
