On Tue, 4 Dec 2007 13:19:16 -0600, Brad Knowles wrote: > > It was 25Mb maximum in my previous letter, now it is 36Mb: > > > > $ top > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > > 17660 mailman 15 0 101M 36M 2668 S 0.0 1.8 0:41.33 qrunner > > 32356 mailman 15 0 100M 35M 2668 S 0.0 1.7 0:38.30 qrunner > > 17584 mailman 15 0 100M 35M 2668 S 0.0 1.7 0:40.04 qrunner > > 32739 mailman 18 0 99.7M 34M 2660 S 0.0 1.7 0:33.94 qrunner > > 3182 mailman 15 0 99.5M 34M 2668 S 0.0 1.7 0:39.10 qrunner > > .... > > > > Some of them took up to 200Mb (!) before I had to restart them. > > All this looks like slow and fast memory leak. > > That's not so different from what we've got on python.org (see > <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.015.htp>), > and the RSS for our qrunners is between 11MB and 41MB, depending on > the specific runner. Note that neither yours nor ours are sucking up > any CPU time, so they're primed for being paged or swapped out if you > do run into any memory pressure. Also note that all that Linux stats > quoted on > <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq04.056.htp> > are from the python.org machines. > > I'm not a Linux performance tuning expert, but I'm not seeing any > real problems in what you've shown us so far. If you are seeing > problems, then you might want to consult a Linux performance tuning > expert.
The problem is that some qrunners quickly eat memory. Most of them use 20-37Mb after 13 hours of running. But today several qrunners 6 times took above 200Mb! Fortunately now I have Monit that checks memory usage, and kills such runners. I wrote previous letter after server failure when 2 greedy qrunners took 249 and 235 Mb. In that moment even crond couldn't fork and mail delivery was aborted. After that I have increased memory limit to 2Gb and started Monit daemon to prevent such failure. -- Grigory Batalov, ALT Linux Team
pgpcThbwiH5uw.pgp
Description: PGP signature
------------------------------------------------------ Mailman-Users mailing list [email protected] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.027.htp
