Hello, I'm trying to figure out some performance issues with mailman. I have it configured for SMTP direct, and pointed at localhost, port 25. The MTA is sendmail. Sendmail is configured to use our exchange server as a smart host. We have two lists configured and send out 1 message a month to each list. It usually takes about 12-24 hours to finish sending all the messages. There are never more than about 5 to 10 messages in the sendmail queue at any given time, so this leads me to believe that the bottleneck is not on the sendmail side.
I've configured mailman for 48 outgoing qrunners, and have tried as many as 72 qrunners, with no noticeable difference, it's like it's using only the 1st outgoing qrunner to process the message and the rest stay there idle. And then it uses that one qrunner process to create each separate message. So 12k individual messages processed by one qrunner thread each time. Is there some way to speed this up and/or get it to use multiple outgoing qrunners simultaneously for the same post, since with personalization it has to create individual copies of each message? The other odd thing is it doesn't log all 12K messages in the smtp log from mailman, but it logs more than 1. I would have thought it would either log only 1 message, or all 12K messages. Here is the SMTP log from mailman: Sep 26 14:13:17 2013 (12407) <[email protected]> smtp to newsletter for 1 recips, completed in 10.368 seconds Sep 26 15:11:57 2013 (12439) <[email protected]> smtp to newsletter for 1 recips, completed in 8.107 seconds Sep 26 15:42:19 2013 (12381) <[email protected]> smtp to newsletter for 1 recips, completed in 0.086 seconds Sep 26 16:56:31 2013 (12458) <[email protected]> smtp to newsletter for 1 recips, completed in 11.179 seconds Sep 26 17:21:12 2013 (12469) <[email protected]> smtp to newsletter for 1 recips, completed in 1.012 seconds Sep 26 19:10:10 2013 (12429) <[email protected]> smtp to newsletter for 1 recips, completed in 10.988 seconds Sep 26 20:23:43 2013 (12449) <[email protected]> smtp to newsletter for 1 recips, completed in 6.958 seconds Sep 27 00:47:25 2013 (12380) <[email protected]> smtp to newsletter for 1 recips, completed in 6.096 seconds Sep 27 01:17:13 2013 (12448) <[email protected]> smtp to newsletter for 1 recips, completed in 6.166 seconds Sep 27 02:11:27 2013 (12442) <[email protected]> smtp to newsletter for 1 recips, completed in 5.095 seconds Sep 27 02:30:36 2013 (12399) <[email protected]> smtp to newsletter for 1 recips, completed in 6.013 seconds Sep 27 02:40:08 2013 (12472) <[email protected]> smtp to newsletter for 1 recips, completed in 5.356 seconds Sep 27 05:07:31 2013 (12380) <[email protected]> smtp to newsletter for 1 recips, completed in 0.083 seconds Sep 27 05:08:20 2013 (12422) <[email protected]> smtp to newsletter for 1 recips, completed in 0.077 seconds Sep 27 05:08:23 2013 (12474) <[email protected]> smtp to newsletter for 1 recips, completed in 0.073 seconds Sep 27 05:31:24 2013 (12438) <[email protected]> smtp to newsletter for 1 recips, completed in 10.251 seconds Sep 27 06:56:34 2013 (12469) <[email protected]> smtp to newsletter for 1 recips, completed in 5.967 seconds Sep 27 06:56:50 2013 (12396) <[email protected]> smtp to newsletter for 1 recips, completed in 5.153 seconds Sep 27 07:02:33 2013 (12452) <[email protected]> smtp to newsletter for 1 recips, completed in 10.248 seconds Sep 27 07:59:36 2013 (12406) <[email protected]> smtp to newsletter for 1 recips, completed in 11.085 seconds Sep 27 08:05:46 2013 (12417) <[email protected]> smtp to newsletter for 1 recips, completed in 10.141 seconds Sep 27 08:10:38 2013 (12449) <[email protected]> smtp to newsletter for 1 recips, completed in 10.232 seconds Sep 27 08:11:40 2013 (12435) <[email protected]> smtp to newsletter for 1 recips, completed in 10.093 seconds Sep 27 08:28:37 2013 (12473) <[email protected]> smtp to newsletter for 1 recips, completed in 5.124 seconds Sep 27 08:35:08 2013 (12409) <[email protected]> smtp to newsletter for 1 recips, completed in 10.346 seconds Sep 27 09:51:39 2013 (12428) <[email protected]> smtp to newsletter for 1 recips, completed in 5.045 seconds Sep 27 10:34:31 2013 (12393) <[email protected]> smtp to newsletter for 1 recips, completed in 0.049 seconds Sep 27 11:39:33 2013 (12396) <[email protected]> smtp to newsletter for 1 recips, completed in 15.162 seconds Sep 27 11:40:15 2013 (12389) <[email protected]> smtp to newsletter for 1 recips, completed in 10.073 seconds Sep 27 11:53:41 2013 (12438) <[email protected]> smtp to newsletter for 1 recips, completed in 5.098 seconds Sep 27 13:00:33 2013 (12430) <[email protected]> smtp to newsletter for 1 recips, completed in 10.125 seconds Thanks in advance for any advice/help you can give. Bryan ------------------------------------------------------ Mailman-Users mailing list [email protected] https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
