Re: [Mailman-Users] Mailman throughput

2011-08-15 Thread Brad Knowles
On 08/14/2011 11:24 PM, Ivan Fetch wrote: Brad, I think we are already accomplishing a lot of this minimalism, since the MTA on the Mailman VM is only accepting the message via SMTP, then handing it off to Mailman via the Postfix aliases. The spam and other checks are done before hand, by

Re: [Mailman-Users] Mailman throughput

2011-08-15 Thread Brad Knowles
On 08/15/2011 02:49 AM, Brad Knowles wrote: You're talking about inbound, and how you have outsourced many of these kinds of checks to other boxes. That's fine as far as it goes, but I was talking about *outbound*, from Mailman to the world of recipients. You are likely to have a certain

Re: [Mailman-Users] Mailman throughput

2011-08-15 Thread Ivan Fetch
Hi Brad, On Aug 15, 2011, at 1:49 AM, Brad Knowles wrote: On 08/14/2011 11:24 PM, Ivan Fetch wrote: Brad, I think we are already accomplishing a lot of this minimalism, since the MTA on the Mailman VM is only accepting the message via SMTP, then handing it off to Mailman via the Postfix

[Mailman-Users] Mailman throughput

2011-08-14 Thread Ivan Fetch
Hello, I am trying to gage the capability of a Mailman virtual machine, which we will be moving our lists to. I'd like to do my best to size and tune this VM, and it's Postfix and Mailman installation, before putting it in production, and potentially having to troubleshoot and tune in a hurry.

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Mark Sapiro
Ivan Fetch wrote: What is a reasonable / realistic way to benchmark a Mailman installation? Are there details of other similarly sized instlalations and throughput numbers which I can compare? I don't have any data for a comparable size installation. The benchmark test you describe seems

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Ivan Fetch
Hello, THanks Mark, I appreciate this. MOre below: On Aug 14, 2011, at 11:39 AM, Mark Sapiro wrote: It seems the major hurdle is in processing the 'out' queue. It is possible to slice OutgoingRunner to provide some parallelism in this process and that may speed things up, but I suspect that

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Mark Sapiro
On 8/14/2011 1:39 PM, Ivan Fetch wrote: On Aug 14, 2011, at 11:39 AM, Mark Sapiro wrote: It seems the major hurdle is in processing the 'out' queue. It is possible to slice OutgoingRunner to provide some parallelism in this process and that may speed things up, but I suspect that a lot of

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Ivan Fetch
Hello, On Aug 14, 2011, at 4:15 PM, Mark Sapiro wrote: No. Threaded delivery in SMTPDirect.py was an experimental feature in Mailman 2.0. It was never implemented for Mailman 2.1 although the setting and its documentation were not removed from Defaults.py. Setting this in mm_cfg.py has no

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Mark Sapiro
On 8/14/2011 4:25 PM, Ivan Fetch wrote: I noticed that the incoming qrunner was using 10% CPU (according to the pcpu column of ps) even after qfiles/in was empty, and after all 5000 messages were processed. I wonder what the incoming runner is doing - any ideas there? If I am not

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Brad Knowles
On 08/14/2011 03:39 PM, Ivan Fetch wrote: There are some MTA tuning tips in the FAQ http://wiki.list.org/x/AgA3, but some are only applicable to Mailman 2.0 so be careful. The majority of the MTA tuning tips that I know of should be applicable to most any mailing list manager, since they are

Re: [Mailman-Users] Mailman throughput

2011-08-14 Thread Ivan Fetch
Hi Brad, On Aug 14, 2011, at 8:44 PM, Brad Knowles wrote: The majority of the MTA tuning tips that I know of should be applicable to most any mailing list manager, since they are oriented towards helping the MTA better deal with large amounts of outgoing mail, and optimizing certain types