Howdy,
I have alot of success with qmail and ezmlm over the years. Last night
qmail and ezmlm sent 76,000 emails, from 12 lists, in four hours.
That's decent, but the server resouces (big bad powerful dual 600's,
1/2gig, 10k LVD-3, raid0 /w 128 cache, 100bt, HOOT HOOT!!) wasn't even
close to be pushed to their limits and it seamed qmail-send was limited
because of the way qmail-queue handle queuing. Let me explain:
A week ago, a user asked me to build a list for their mailing list
becuase their server couldn't handle it and wanted to use my big power
evil qmail server. Last night the user sent messages to the lists "one
after another". It produced 12 file, about 1.6 megs a piece in remote,
one per dir, so conf-split wouldn't help. We all know that qmail
currently handle the queue on a first come, first serve basis. Each of
the lists are sorted by group. Most of the address in a group are to
the same server, but not all addresses. I have no choice in the way
they are grouped because the message for each group/list is uquie for
the group, even tough the majority of the body of the message is the
same. The qmail server was being slowed down by the other guy's
server. Instead of sending to list1, X amount mail to server A, Y
amount to server B, while doing the same for lists 2-12, qmail was going
through the list in an extremely simple and wasteful way: " list1,
message1, done, message2, done... message 20,000, done, list2, message
1.... list12, message1, done.... message 20,000, done".
I believe qmail-queue should be aware of the limits of the other guy's
machine, and thus should not limit qmail-send. Of course, Multi-RCPT
would require *MAJOR* work but getting qmail-queue to understand serverA
can take 20 connections at a time and ServerB can take 50, so keep 20
connection open, deliever 20 message to ServerA while sending 50 to
serverB, and if qmail runs out of new servers for list1, move on to
lists2, or what ever along as the local server is being pushed hard,
wouldn't take too much work, just another process to keep track of the
stats and direct qmail-queue.
Currently it appear the queuing is a limiting power of a powerful qmail
server. Is there anything I can do to better the queuing in qmail? Any
setting changes? Has anyone wrote a patch for qmail-queue to handle
mail at the server level? Is anyone willing to write a patch? How do
other people, handle:
(15,000 messages to one server/domain) * 12
Thanks,
Steven Rice
Reply with flames and lame comments to [EMAIL PROTECTED]
