Re: qmail is slow
Charles: Hi ..Thanks for the reply! Charles Cazabon wrote: Federico Edelman Anaya [EMAIL PROTECTED] wrote: Dave Sill wrote: You might also want to set up a second qmail installation on the central server to do nothing but handle messages injected via SMTP. That will allow the qmail-send sending the ezmlm messages to go full speed by offloading bounce messages delivery to another qmail-send process. Ummmh.. I don't understand how can I install 2 qmail in the same server?? Unpack the qmail source in a separate place. Change conf-qmail to /var/qmail2. Do make setup check. Start qmail-smtpd from the second instance to receive bounces. Ok ... but, what do I need with the /var/qmail/queue? Must be the same or linked? How can I do for the connection two Qmails? Thanks! Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: qmail is slow
Federico Edelman Anaya [EMAIL PROTECTED] wrote: Charles Cazabon wrote: Federico Edelman Anaya [EMAIL PROTECTED] wrote: Dave Sill wrote: You might also want to set up a second qmail installation on the central server to do nothing but handle messages injected via SMTP. That will allow the qmail-send sending the ezmlm messages to go full speed by offloading bounce messages delivery to another qmail-send process. Ummmh.. I don't understand how can I install 2 qmail in the same server?? Unpack the qmail source in a separate place. Change conf-qmail to /var/qmail2. Do make setup check. Start qmail-smtpd from the second instance to receive bounces. Ok ... but, what do I need with the /var/qmail/queue? Must be the same or linked? No, no, no -- that would break lots of things. Your first instance of qmail lives in /var/qmail/ and handles all your outgoing list mail. It's mail queue is in /var/qmail/queue/, the binaries are in /var/qmail/bin/, control files in /var/qmail/control, etc. You don't run qmail-smtpd for this instance. The second instance of qmail lives in /var/qmail2/ . The queue is in /var/qmail2/queue/ . Binaries are in /var/qmail2/bin/ . Control files are in /var/qmail2/control/ . You run /var/qmail2/bin/qmail-smtpd (through tcpserver) on port 25 to accept bounces from the outgoing list mails from the other qmail instance. That way, bounces are injected into /var/qmail2/queue/ instead of /var/qmail/queue/ -- and you don't run into the problem where qmail-send from the first instance of qmail has to pause processing of outgoing messages to handle incoming ones. How can I do for the connection two Qmails? There is no connection, really. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: qmail is slow
[EMAIL PROTECTED] wrote: Well, when the Qmail of Central Server send a list (for example) about 45.000 email subscribers, the Mail Relay's servers send about of 20 email at the same time. Its very slowly! But, when the Central Server finish, the qmail of Mail Relay send 500 mails at the same time. Why? Because qmail-send is single-threaded, and must split its attention between processing new messages and passing processed messages to qmail-rspawn. How can I do for the Qmail process send/receive have the same priority? I need the qmail send a constant of 500 mails. Any idea? Don't pass the deliveries off to relays. In doing so, you're taking one message with 45000 recipients and making it 45000 messages with one recipient. You might also want to set up a second qmail installation on the central server to do nothing but handle messages injected via SMTP. That will allow the qmail-send sending the ezmlm messages to go full speed by offloading bounce messages delivery to another qmail-send process. -Dave
RE: qmail is slow
Don't pass the deliveries off to relays. In doing so, you're taking one message with 45000 recipients and making it 45000 messages with one recipient. This brings up an interesting question. If I'm sending a message to 100k people, but I need a unique unsubscribe link at the end, can qmail be convinced that it's only one message, and 100k recipients? I.E. Dear reader- samesamsamesame samesame ... same. --Me My Company To remove yourself from this list, click here: http://www.foo.com/unsubscribe.cgi?e=joe:=user.com In this example everything is the same except the link, and the link is derived from the To: header. Basically, what I'm asking is if there is a more efficient way of creating the unique link than injecting the message 100k times. --joshua.
Re: qmail is slow
Joshua Nichols [EMAIL PROTECTED] wrote: This brings up an interesting question. If I'm sending a message to 100k people, but I need a unique unsubscribe link at the end, can qmail be convinced that it's only one message, and 100k recipients? I.E. There's a patch for ezmlm-idx which enables this feature. It's called verhl or some such. I'm sure you can find a pointer to it at ezmlm.org. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
RE: qmail is slow
Joshua Nichols [EMAIL PROTECTED] wrote: This brings up an interesting question. If I'm sending a message to 100k people, but I need a unique unsubscribe link at the end, can qmail be convinced that it's only one message, and 100k recipients? Not stock qmail, but Russ Nelson has such a critter. It ain't cheap, though. -Dave
Re: qmail is slow
Dave Sill wrote: [EMAIL PROTECTED] wrote: Well, when the Qmail of Central Server send a list (for example) about 45.000 email subscribers, the Mail Relay's servers send about of 20 email at the same time. Its very slowly! But, when the Central Server finish, the qmail of Mail Relay send 500 mails at the same time. Why? Because qmail-send is single-threaded, and must split its attention between processing new messages and passing processed messages to qmail-rspawn. How can I do for the Qmail process send/receive have the same priority? I need the qmail send a constant of 500 mails. Any idea? Don't pass the deliveries off to relays. In doing so, you're taking one message with 45000 recipients and making it 45000 messages with one recipient. How can I do this? without ezmlm? You might also want to set up a second qmail installation on the central server to do nothing but handle messages injected via SMTP. That will allow the qmail-send sending the ezmlm messages to go full speed by offloading bounce messages delivery to another qmail-send process. Ummmh.. I don't understand how can I install 2 qmail in the same server?? Could you explain me how? Thanks !! -Dave
Re: qmail is slow
Federico Edelman Anaya [EMAIL PROTECTED] wrote: Dave Sill wrote: You might also want to set up a second qmail installation on the central server to do nothing but handle messages injected via SMTP. That will allow the qmail-send sending the ezmlm messages to go full speed by offloading bounce messages delivery to another qmail-send process. Ummmh.. I don't understand how can I install 2 qmail in the same server?? Unpack the qmail source in a separate place. Change conf-qmail to /var/qmail2. Do make setup check. Start qmail-smtpd from the second instance to receive bounces. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: Qmail - to slow?
On Thu, Mar 01, 2001 at 11:33:29AM +0100, Thomas Knig wrote: [snip] qmail (standard tgz file with only the qmail-date-localtime patch) is compiled with: conf-split = 300 That conf-split is ridiculous. It is way higher than necessary, *and* it is not prime. conf-spawn = 255 /var/qmail/bin: concurrencylocal = 30 concurrencyremote = 100 You might want to up concurrencyremote a lot :) Now I has tried to send a Newsletter to 180.000 subscribers. The system needs 5 1/2 hours for delivery( 9 mails per second), but I mean it's to long?! The average bandwich during the delivery is 70k-100k it's to slightly for an 100mbit Connection. If I look for qmail processes, ther are only 3-5 qmail-remote processes. netstat -an show me 100-200 socket connections to smpt servers on port 25. vmstat shows an average idle time between 65%-78%. memory use is ca. 200 MB, swap is untouched. What can I do, for higher performance? Apply the big-concurrency patch, use ezmlm for your mailinglist. Have I errors in my configuration? Yes, your conf-split is broken. Greetz, Peter.
Re: Qmail - to slow?
Hi, thanks for your answer. Which values are right for my problem? -- tom
Re: Qmail - to slow?
On Thu, Mar 01, 2001 at 02:30:37PM +0100, Thomas Knig wrote: Hi, thanks for your answer. Which values are right for my problem? conf-split should be 23 unless you have *really* good reasons to change it. Greetz, Peter.
Re: Qmail - to slow?
Do you have installed the daemontools? how do you logging? syslog? multilog? Bye! Thomas Knig wrote: Hi, I have been setup a linux-box PII/450, 256MB RAM, 4 GB IDE HDD, 100mbit bandwitch with RehHat 6.2, qmail 1.03 + ezmlm-idx with MySQL + vpopmail. qmail (standard tgz file with only the qmail-date-localtime patch) is compiled with: conf-split = 300 conf-spawn = 255 /var/qmail/bin: concurrencylocal = 30 concurrencyremote = 100 Now I has tried to send a Newsletter to 180.000 subscribers. The system needs 5 1/2 hours for delivery( 9 mails per second), but I mean it's to long?! The average bandwich during the delivery is 70k-100k it's to slightly for an 100mbit Connection. If I look for qmail processes, ther are only 3-5 qmail-remote processes. netstat -an show me 100-200 socket connections to smpt servers on port 25. vmstat shows an average idle time between 65%-78%. memory use is ca. 200 MB, swap is untouched. What can I do, for higher performance? Have I errors in my configuration? -- thomas koenig
Re: Qmail - to slow?
Yes, I have installed daemontools-0.53. I use tcpserver, logging via cyclog. /etc/rc.d/init.d/qmail: echo -n "Starting: " env - PATH="/var/qmail/bin:/usr/local/bin" \ qmail-start ./Maildir/ /usr/local/bin/accustamp \ | /usr/local/bin/setuser qmaill /usr/local/bin/cyclog /var/log/qmail echo -n "qmail " env - PATH="/var/qmail/bin:/usr/local/bin" \ tcpserver -H -R -l$HOSTNAME -c30 0 pop-3 /var/qmail/bin/qmail-popup \ $HOSTNAME \ /home/vpopmail/bin/vchkpw /var/qmail/bin/qmail-pop3d Maildir echo -n "pop " env - PATH="/var/qmail/bin:/usr/local/bin" \ tcpserver -H -R -l$HOSTNAME -x /home/vpopmail/etc/tcp.smtp.cdb -c30 \ -u503 -g502 0 smtp \ /var/qmail/bin/qmail-smtpd 21 /dev/null echo "smtp" -- tom
RE: Qmail very slow???
hi, marchart wrote: Hi again, Why are so many messages not preprocessed? THX mail: ~/perl $ /var/qmail/bin/qmail-qstat messages in queue: 196 messages in queue but not yet preprocessed: 88 mail: ~/perl $ /var/qmail/bin/qmail-qstat ...snip... seen that behavior caused by wrong permissions in /var/qmail/queue/lock. especially the file trigger. here the url to Dave Sill's excellent Life With Qmail (aka LWQ): http://web.infoave.net/~dsill/lwq.html#trigger hope that helps ;) alexander
Re: Qmail very slow???
Your logs? And the output of qmail-showctl... On Thu, Jan 04, 2001 at 11:41:15PM +0100, [EMAIL PROTECTED] wrote: Hi again, Why are so many messages not preprocessed? THX mail: ~/perl $ /var/qmail/bin/qmail-qstat messages in queue: 196 messages in queue but not yet preprocessed: 88 mail: ~/perl $ /var/qmail/bin/qmail-qstat messages in queue: 194 messages in queue but not yet preprocessed: 77 mail: ~/perl $ /var/qmail/bin/qmail-qstat messages in queue: 191 (...) -- Jose AP Celestino [EMAIL PROTECTED] || SAPO / PTM.COM Administração de Sistemas / Operações || http://www.sapo.pt --- "World domination. Fast" (By Linus Torvalds)
Re: qmail-smtp slow!
no ! server has only global IP address Angel Krustev wrote: Do you have a firewall betwin your host and SMTP server? Angel - Original Message - From: Gan [EMAIL PROTECTED] To: Qmail mailing list [EMAIL PROTECTED] Sent: Saturday, November 18, 2000 1:55 PM Subject: qmail-smtp slow! Hello, I'm using qmail for several domains for relaying , i went into trouble since few days ago when i moved my server to another network , the thing is when i'm telneting to smtp port of my server there is a latency (more than 30 sec) before qmail answers me 220 xyz.xom ESMTP the only thing changed ( that i know) is that full C class network changed to sub 128 network . Help me ! and thank you in advance!
Re: qmail-smtp slow!
On Sat, Nov 18, 2000 at 10:14:21PM +0900, Gan wrote: Hello, I'm using qmail for several domains for relaying , i went into trouble since few days ago when i moved my server to another network , the thing is when i'm telneting to smtp port of my server there is a latency (more than 30 sec) before qmail answers me 220 xyz.xom ESMTP the only thing changed ( that i know) is that full C class network changed to sub 128 network . are you using tcpserver to manage qmail-smtpd connections? if yes, try the -H and -R switches to tcpserver (no reverse dns, and no ident). -tacho -- [i don't follow] | [http://daemonz.org/ || [EMAIL PROTECTED]] [everything should be made as simple as possible, but no simpler] 0x44FC3339 || [02B5 798B 4BD1 97FB F8DB 72E4 DCA4 BE03 44FC 3339] PGP signature
Re: qmail-smtp slow!
I agree, it's probably a DNS problem. Check your DNS connectivity with nslookup commands. Stanislav Grozev wrote: On Sat, Nov 18, 2000 at 10:14:21PM +0900, Gan wrote: Hello, I'm using qmail for several domains for relaying , i went into trouble since few days ago when i moved my server to another network , the thing is when i'm telneting to smtp port of my server there is a latency (more than 30 sec) before qmail answers me 220 xyz.xom ESMTP the only thing changed ( that i know) is that full C class network changed to sub 128 network . are you using tcpserver to manage qmail-smtpd connections? if yes, try the -H and -R switches to tcpserver (no reverse dns, and no ident). -tacho -- [i don't follow] | [http://daemonz.org/ || [EMAIL PROTECTED]] [everything should be made as simple as possible, but no simpler] 0x44FC3339 || [02B5 798B 4BD1 97FB F8DB 72E4 DCA4 BE03 44FC 3339] Part 1.2Type: application/pgp-signature begin:vcard n:Lagente;Philippe tel;cell:33 (0)6 80 45 27 32 tel;fax:33 (0)1 39 44 02 44 tel;work:33 (0)1 39 44 29 99 x-mozilla-html:FALSE url:www.avs-consulting.com org:AVS Consulting adr:;;130,136 av Joseph Kessel;Voisins le Bretonneux;;78960;France version:2.1 email;internet:[EMAIL PROTECTED] title:Directeur fn:Philippe Lagente end:vcard
Re: qmail-smtp slow!
I also thought about DNS , server's resolv.conf looks for DNS server on another network, what whould be the exact problem with DNS? Philippe Lagente wrote: I agree, it's probably a DNS problem. Check your DNS connectivity with nslookup commands. Stanislav Grozev wrote: On Sat, Nov 18, 2000 at 10:14:21PM +0900, Gan wrote: Hello, I'm using qmail for several domains for relaying , i went into trouble since few days ago when i moved my server to another network , the thing is when i'm telneting to smtp port of my server there is a latency (more than 30 sec) before qmail answers me 220 xyz.xom ESMTP the only thing changed ( that i know) is that full C class network changed to sub 128 network . are you using tcpserver to manage qmail-smtpd connections? if yes, try the -H and -R switches to tcpserver (no reverse dns, and no ident). -tacho -- [i don't follow] | [http://daemonz.org/ || [EMAIL PROTECTED]] [everything should be made as simple as possible, but no simpler] 0x44FC3339 || [02B5 798B 4BD1 97FB F8DB 72E4 DCA4 BE03 44FC 3339] Part 1.2Type: application/pgp-signature
Re: qmail-smtp slow!
Here is my qmail-smtpd run script ( as in Life With Queue Mail): #!/bin/sh QMAILDUID=`id -u qmaild` NOFILESGID=`id -g qmaild` exec /usr/local/bin/softlimit -m 200 \ /usr/local/ucspi-tcp/bin/tcpserver -c 128 -v -H -R\ -u $QMAILDUID -g $NOFILESGID 0 smtp /usr/local/ucspi-tcp/bin/rblsmtpd /var/qmail/bin/qmail-smtpd 21 Stanislav Grozev wrote: On Sat, Nov 18, 2000 at 10:14:21PM +0900, Gan wrote: Hello, I'm using qmail for several domains for relaying , i went into trouble since few days ago when i moved my server to another network , the thing is when i'm telneting to smtp port of my server there is a latency (more than 30 sec) before qmail answers me 220 xyz.xom ESMTP the only thing changed ( that i know) is that full C class network changed to sub 128 network . are you using tcpserver to manage qmail-smtpd connections? if yes, try the -H and -R switches to tcpserver (no reverse dns, and no ident). -tacho -- [i don't follow] | [http://daemonz.org/ || [EMAIL PROTECTED]] [everything should be made as simple as possible, but no simpler] 0x44FC3339 || [02B5 798B 4BD1 97FB F8DB 72E4 DCA4 BE03 44FC 3339] Part 1.2Type: application/pgp-signature
Re: qmail-smtp slow!
On Sat, Nov 18, 2000 at 11:37:32PM +0900, Gan wrote: Here is my qmail-smtpd run script ( as in Life With Queue Mail): #!/bin/sh QMAILDUID=`id -u qmaild` NOFILESGID=`id -g qmaild` exec /usr/local/bin/softlimit -m 200 \ /usr/local/ucspi-tcp/bin/tcpserver -c 128 -v -H -R\ -u $QMAILDUID -g $NOFILESGID 0 smtp /usr/local/ucspi-tcp/bin/rblsmtpd /var/qmail/bin/qmail-smtpd 21 Try adding -l0 (that's el zero) to the tcpserver options. Chris
