qmail Digest 17 Jul 2000 10:00:00 -0000 Issue 1065 Topics (messages 44836 through 44854): Re: Announcing qmail-autoresponder version 0.90 44836 by: Russ Allbery Re: Domain forwarding] 44837 by: Henry Baragar Qmail is *NOT* reliable with ReiserFS 44838 by: Jedi/Sector One ERR Authorization failed w/qmail-pop 44839 by: James Phillips Announcing: SPAMCONTROL 1.3.0 44840 by: Erwin Hoffmann Re: ERR Authorization failed w/qmail-pop (New) 44841 by: Hubbard, David 44842 by: James Phillips pop3d questions 44843 by: Tony Campisi 44844 by: Henry Baragar Re: scan4virus problem 44845 by: Jason Haar checking and fixing ownership of files 44846 by: Vincent Danen Re: questions about performance and setup 44847 by: Oliver White 44848 by: markd.bushwire.net 44849 by: Steve Wolfe bounce management 44850 by: Thomas Duterme ESMTP 44851 by: Tobias Neubert 44853 by: Jedi/Sector One sqwebmail cannot compile 44852 by: Jia Rong rc file problem 44854 by: Georg Thoma Administrivia: To unsubscribe from the digest, e-mail: [EMAIL PROTECTED] To subscribe to the digest, e-mail: [EMAIL PROTECTED] To bug my human owner, e-mail: [EMAIL PROTECTED] To post to the list, e-mail: [EMAIL PROTECTED] ----------------------------------------------------------------------
Bruce Guenter <[EMAIL PROTECTED]> writes: > On Fri, Jul 14, 2000 at 06:28:44PM -0700, Russ Allbery wrote: >> I consider it to be an absolute requirement for any autoresponder to >> not reply to a message that isn't addressed to the recipient it is >> acting on behalf of. > And that's part of why it's rate limited. Rate limiting will indeed cover up a multitude of sins, but it's still possible even with a rate-limited autoresponder to generate responses to mailing list traffic. Another significant ameliorating factor in your implementation, though, is... > By default, it will only reply to a particular sender address once an > hour, no matter how many are sent. Hmmmm. Ezmlm uses a different > recipient address each time (but ezmlm will also add both a "Precedence: > bulk" and a "Delivered-To: mailing list ..." header). ...that it sounds like you're sending your replies to the envelope sender, and therefore it's somewhat less likely they would end up on the mailing list. There are various schools of thought on this topic. My experience is that sending the autoreply to the From/Reply-To address is generally what people expect and that sending it to the envelope sender can often be confusing or unsuccessful. But using the envelope sender is certainly cleaner from an implementation standpoint, and helps avoid a few of the problems of mailing lists, at least for mailing lists managed by software. > I understand the argument you're making, and it's valid to a degree. If > you want to contribute a simple GPL-able RFC822 parser, I'll make it a > feature of my autoresponder. That's not the main problem. That's a tractable technical problem, even if annoying. The real problem is that unless you're willing to let your autoresponder generate significantly fewer responses than the person would expect, you have to deal with alternate forms of their address. For example, there are literally hundreds of rra@*.stanford.edu address forms that all deliver to [EMAIL PROTECTED], and unfortunately in some cases a not insignificant number of them are in use for various things or due to various historical reasons. You're correct that I overstated my feelings somewhat, and determining whether a given e-mail address was addressed directly to the recipient in the To or Cc header is not a fully solveable problem. The rather ugly hack that I'm currently using is: my @addressees = ($addressees =~ /(?:^|\G|\s)(\S+)\@\S+\.\S+\s/g); (and then applying some canonicalization to deal with removing the leading bracket, supporting varient forms that our LDAP database supports, and removing the "sub-address" parts). This fails to recognize all sorts of weird addressing forms that are fairly uncommon in practice. This is reasonable for my purposes since the algorithm "fails closed"; if it can't find the recipient, it doesn't send an autoreply. More worrisome is the fact that it only considers the username portion, in part to deal with the address varient problem mentioned above (and because that was the historical behavior of the autoresponder that I was rewriting to use LDAP instead of our old method of handling vacation). In practice, though, that seems to work reasonably well. This is certainly not a substitute for rate limiting or for watching for list headers and not replying to those messages. (My autoresponder also refuses to reply to any message coming from an envelope sender ending in -request or containing any of the words daemon, postmaster, mailer-daemon, mailer, root, or majordomo.) In combination with those other checks, though, the additional check makes me feel a lot better about releasing the autoresponder on an unsuspecting Internet. Autoresponses to mailing list traffic are a personal annoyance of mine; every time I, for example, send mail to the CVS mailing list, I get three or four vacation messages and I'm extremely tired of it. Given how much it annoys me personally, I wanted to be reasonably certain that I wouldn't be the cause of someone else being similarly annoyed. > Or list-id, or mailing-list, or x-mailing-list, or x-ml-name. I should > actually add a test for ezmlm to check if a "Delivered-To:" line starts > with "mailing list ". I believe ezmlm always adds Mailing-List and Precedence; given that, I don't see a reason for adding another rule. (Precedence has been an informal standard for many years now, and no reasonably maintained mailing list management package really has much excuse for not using it, IMO.) -- Russ Allbery ([EMAIL PROTECTED]) <http://www.eyrie.org/~eagle/>
Michael, This can easily be accomplished using qmail: 1. Add first.com and second.com to control/rcpthosts 2. Put second.com (but not first.com) into control/locals 3. Make sure the MX record for first.com in your internal DNS points to MS-Exchange This tells qmail to accept mail for both first.com and second.com, but to handle only second.com locally. Henry Michael Hinds wrote: > Hello, > > Our company has always used MS-Exchange for internet e-mail, but we are > trying to add a Linux/qmail server to the configuration. > We're currently using a Raptor firewall to route all SMTP transmissions > to the MS box. For the sake of example, we'll call our original domain > first.com. > > What we want to do is host a separate domain on the qmail server (say, > second.com). The problem is, our firewall can't decide where mail is > destined for, it can only recognise the protocol. So we either have to > route all mail to qmail and make qmail accept mail for second.com and > forward all first.com mail to the MS server, or route all mail to the MS > server and make that accept mail for first.com and forward all > second.com mail to qmail. > > The first option would be preferrable, but by now I'm willing to try > anything. I'm having trouble finding any concrete examples or documents > describing how to do this. I've found lots of ways to forward mail for > particular e-mail addresses, but not for whole domains. I don't want to > set up users on the qmail server for all the e-mail users on the MS box. > > I've installed fastforward, but the documentation is skimpy! It points > me to the aliases docs, which don't appear to tell me how to do this > either. > > Somebody, please, point me in the right direction! > > Many thanks, > > Michael HindsS/MIME Cryptographic Signature
ReiserFS does not commit link() synchronously (mounting with "sync" doesn't change anything). Therefore, if there is a power outage during the Maildir delivery or if qmail-smtpd answered the final "queued" message without actually commiting the link in queue/todo, the message will not be processed by qmail-send. Here is a patch to make Qmail more reliable for Linux users using a ReiserFS partition. Best regards, -- Frank DENIS aka Jedi/Sector One aka DJ Chrysalis <[EMAIL PROTECTED]> -> Software : http://www.jedi.claranet.fr <- If Bill Gates had a dime for every time a Windows box crashed... ...oh, wait a minute -- he already does.--- ../qmail-1.03.orig/qmail-local.c Mon Jun 15 12:53:16 1998 +++ qmail-local.c Sun Jul 16 16:19:04 2000 @@ -1,5 +1,6 @@ #include <sys/types.h> #include <sys/stat.h> +#include <fcntl.h> #include "readwrite.h" #include "sig.h" #include "env.h" @@ -128,6 +129,9 @@ if (close(fd) == -1) goto fail; /* NFS dorks */ if (link(fntmptph,fnnewtph) == -1) goto fail; + if ((fd = open(fnnewtph, O_RDONLY)) < 0 || + fsync(fd) < 0 || close(fd) < 0) goto fail; + /* if it was error_exist, almost certainly successful; i hate NFS */ tryunlinktmp(); _exit(0); --- ../qmail-1.03.orig/qmail-queue.c Mon Jun 15 12:53:16 1998 +++ qmail-queue.c Sun Jul 16 16:19:33 2000 @@ -1,5 +1,6 @@ #include <sys/types.h> #include <sys/stat.h> +#include <fcntl.h> #include "readwrite.h" #include "sig.h" #include "exit.h" @@ -155,6 +156,7 @@ { unsigned int len; char ch; + int fd; sig_blocknone(); umask(033); @@ -183,7 +185,7 @@ todofn = fnnum("todo/",0); intdfn = fnnum("intd/",0); - if (link(pidfn,messfn) == -1) die(64); + if (link(pidfn,messfn) == -1) die(64); if (unlink(pidfn) == -1) die(63); flagmademess = 1; @@ -248,6 +250,8 @@ if (fsync(intdfd) == -1) die_write(); if (link(intdfn,todofn) == -1) die(66); + if ((fd = open(todofn, O_RDONLY)) < 0 || + fsync(fd) < 0 || close(fd) < 0) die(66); triggerpull(); die(0);
I have setup qmail+qmailadmin with all associated packages. I have set up a few accounts via qmailadmin and am able to send messages with out a problem. Now I want to use pop3 to get messages from qmail. I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail package. I installed checkpassword but I always get -ERR authorization failed even using a valid password. I tried accessing the pop server via Outlook Express to verifiy that pop server is running and it is because it gives me the error: There was a problem logging onto your mail server. Your Password was rejected. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server Response: '-ERR aack, child crashed', Port: 110, Secure(SSL): No, Server Error: 0x800CCC90, Error Number: 0x800CCC92 Any help would be appreciated as I am stuck here. James Phillips _____________________________________________________________ Get free email at http://www.Kidsware.com. Keeping an Eye on the KIDS SoftWARE Industry.
Hi, a new version of the SPAMCONTROL patch is available by now. Version 1.3.0 includes now Will Harris' SMTP SIZE extension. Pls. check my Web-Site http://www.fehcom.de/qmail_en.html For users of Version 1.2.1: Pls upgrade to 1.2.2 or 1.3.0. Due to a mistake generating the archive, mods from Version 1.2.0 to Version 1.2.1 were not incorporated. I have to apologize. Tx. cheers. eh. +-----------------------------------------------------------------------+ | fff hh http://www.fehcom.de Dr. Erwin Hoffmann | | ff hh | | ff eee hhhh ccc ooo mm mm mm Wiener Weg 8 | | fff ee ee hh hh cc oo oo mmm mm mm 50858 Koeln | | ff ee eee hh hh cc oo oo mm mm mm | | ff eee hh hh cc oo oo mm mm mm Tel 0221 484 4923 | | ff eeee hh hh ccc ooo mm mm mm Fax 0221 484 4924 | +-----------------------------------------------------------------------+
I'd like to add a question on to James' problems. I'm doing the same thing, my setup is working, but if a user enters a bad password, he gets the message as shown below. Is there really a process crashing? And is it not cleaning up after itself? So this could end up causing problems later? Also, when someone doesn't log in correctly and I get that child crashed message, there is no mention of the connection in the logs, that is not good, someone could hit my server all day using brute force and I'd never know... Thanks, Dave -----Original Message----- From: James Phillips [mailto:[EMAIL PROTECTED]] Sent: Sunday, July 16, 2000 2:44 PM To: [EMAIL PROTECTED] Subject: ERR Authorization failed w/qmail-pop I have setup qmail+qmailadmin with all associated packages. I have set up a few accounts via qmailadmin and am able to send messages with out a problem. Now I want to use pop3 to get messages from qmail. I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail package. I installed checkpassword but I always get -ERR authorization failed even using a valid password. I tried accessing the pop server via Outlook Express to verifiy that pop server is running and it is because it gives me the error: There was a problem logging onto your mail server. Your Password was rejected. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server Response: '-ERR aack, child crashed', Port: 110, Secure(SSL): No, Server Error: 0x800CCC90, Error Number: 0x800CCC92 Any help would be appreciated as I am stuck here. James Phillips _____________________________________________________________ Get free email at http://www.Kidsware.com. Keeping an Eye on the KIDS SoftWARE Industry.
Actually sometimes I get that error and other times I get: Unable to logon to the server using Secure Password Authentication. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server Response: '-ERR authorization first', Port: 110, Secure(SSL): No, Server Error: 0x800CCC90, Error Number: 0x800CCC18 Problem is it always fails, even when I telnet to 110 on the host machine. --- "Hubbard, David" <[EMAIL PROTECTED]> > wrote: >I'd like to add a question on to James' problems. I'm doing >the same thing, my setup is working, but if a user enters >a bad password, he gets the message as shown below. Is there >really a process crashing? And is it not cleaning up after >itself? So this could end up causing problems later? Also, >when someone doesn't log in correctly and I get that child >crashed message, there is no mention of the connection in the >logs, that is not good, someone could hit my server all day >using brute force and I'd never know... > >Thanks, > >Dave > >-----Original Message----- >From: James Phillips [mailto:[EMAIL PROTECTED]] >Sent: Sunday, July 16, 2000 2:44 PM >To: [EMAIL PROTECTED] >Subject: ERR Authorization failed w/qmail-pop > > >I have setup qmail+qmailadmin with all associated packages. I have set up a >few accounts via qmailadmin and am able to send messages with out a problem. > >Now I want to use pop3 to get messages from qmail. > >I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail >package. I installed checkpassword but I always get -ERR authorization >failed even using a valid password. > >I tried accessing the pop server via Outlook Express to verifiy that pop >server is running and it is because it gives me the error: > >There was a problem logging onto your mail server. Your Password was >rejected. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server >Response: '-ERR aack, child crashed', Port: 110, Secure(SSL): No, Server >Error: 0x800CCC90, Error Number: 0x800CCC92 > >Any help would be appreciated as I am stuck here. > >James Phillips > > >_____________________________________________________________ >Get free email at http://www.Kidsware.com. Keeping an Eye on the KIDS >SoftWARE Industry. _____________________________________________________________ Get free email at http://www.Kidsware.com. Keeping an Eye on the KIDS SoftWARE Industry.
Hi, I created a /var/qmail/supervise/qmail-pop3d/run file #!/bin/sh QMAILDUID=`id -u qmaild` NOFILESGID=`id -g qmaild` exec /usr/local/bin/softlimit -m 2000000 \ /usr/local/bin/tcpserver -v -R 0 pop3 /var/qmail/bin/qmail-popup mailperson2.cardinalservices.com \ /usr/local/bin/checkpassword /var/qmail/bin/qmail-pop3d Maildir 2>&1 Does anyone see any drawbacks to running pop3d like this? My /var/log/qmail/pop3d/current files contents look like this: @4000000039720b74038df72c tcpserver: end 3255 status 256 @4000000039720b74038ee574 tcpserver: status: 0/40 I want my log files to have dates that I can read. I tried putting this in my /var/qmail/supervise/qmail-pop3d/log/run file but it's not working as planned. exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t | /usr/local/bin/tai64nlocal /var/log/qmail/pop3d Can someone tell me if I am anywhere close to getting this right? thanks tony.campisi
Tony, I am doing the same thing. To see readable dates, use: tai64nlocal </var/log/qmail/pop3d/current Henry Tony Campisi wrote: > Hi, > I created a /var/qmail/supervise/qmail-pop3d/run file > > #!/bin/sh > QMAILDUID=`id -u qmaild` > NOFILESGID=`id -g qmaild` > exec /usr/local/bin/softlimit -m 2000000 \ > /usr/local/bin/tcpserver -v -R 0 pop3 /var/qmail/bin/qmail-popup > mailperson2.cardinalservices.com \ > /usr/local/bin/checkpassword /var/qmail/bin/qmail-pop3d Maildir 2>&1 > > Does anyone see any drawbacks to running pop3d like this? > > My /var/log/qmail/pop3d/current files contents look like this: > @4000000039720b74038df72c tcpserver: end 3255 status 256 > @4000000039720b74038ee574 tcpserver: status: 0/40 > > I want my log files to have dates that I can read. I tried putting this in > my /var/qmail/supervise/qmail-pop3d/log/run file but it's not working as > planned. > > exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t | > /usr/local/bin/tai64nlocal /var/log/qmail/pop3d > > Can someone tell me if I am anywhere close to getting this right? > > thanks > tony.campisibegin:vcard n:Baragar;Henry tel;cell:416-453-5626 tel;work:416-453-5626 x-mozilla-html:TRUE url:www.instantiated.on.ca org:Instantiated Software Inc. adr:;;130 Banff Road;Toronto;Ontario;M4P 2P5;Canada version:2.1 email;internet:[EMAIL PROTECTED] title:Principal fn:Henry Baragar end:vcardS/MIME Cryptographic Signature
On Sat, Jul 15, 2000 at 12:05:30PM +0300, Kimmo Berghäll wrote: > Hello, > > If I put QMAILQUEUE="/var/qmail/antivirus-qmail-queue.pl" > export QMAILQUEUE > to /etc/rc.d/init.d/qmail I get "qq temporary problem (#4.3.0) when I > try to send mail. > > I have applied qmail-queue patch You should really join the Scan4Virus mailing-list via [EMAIL PROTECTED] instead of worrying every other Qmail site :-) Anyway, make sure you're running the latest release (0.53). Then make sure you did like it asked. Have you su'ed to qmaild and run "/var/qmail/antivirus-qmail-queue.pl -g" to test that perl scripts can run setuid to another usercode on your system? If not that's your problem (and I bet it is). Read the documentation about what to do in that case - it may help... -- Cheers Jason Haar Unix/Network Specialist, Trimble NZ Phone: +64 3 9635 377 Fax: +64 3 9635 417
I know you can use instcheck to verify if the owners/permissions of files are correct, but is there something I can use to fix this? I'm sure there is a tool of some sort I can use to verify all permissions and fix them if incorrect (besides doing another make install). Reason I ask is I'm almost finished an RPM to install the stock qmail (no patches) and it would make life so much easier if I could run a script or program afterwards to fix all permissions/ownership issues since RPM makes a mess of some of them (particularly directories). Any ideas how I can do this? Thanks. -- [EMAIL PROTECTED], OpenPGP key available on www.keyserver.net Freezer Burn BBS: telnet://bbs.freezer-burn.org . ICQ: 54924721 Webmaster for the Linux Portal Site Freezer Burn: http://www.freezer-burn.org Current Linux uptime: 6 days 18 hours 11 minutes.
We're in a similar situation at the moment. However, we want to send out 100,000 UNIQUE emails per day, expanding to 500,000 or more in the near future. Also, our send window is only actually a couple of hours. I'm trying to work out the best settings for the concurrencyremote and conf-split parameters. Our system is a HP Netserver 2000r PIII-667 RAID5 running Linux. Are there any problems in setting conf-split to a very large value? Is it necessary on a Linux system, assuming a queue size of, say 100,000? Any information appreciated. - Oliver. "Austad, Jay" wrote: > Non-unique emails will most likely be generated by other machines and send > the box running mini-qmail via smtp. Non-unique emails will be a small > percentage of what gets sent out, for now. > > Jay > > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > Sent: Saturday, July 15, 2000 12:10 AM > To: '[EMAIL PROTECTED]' > Subject: Re: questions about performance and setup > > On Fri, Jul 14, 2000 at 07:01:46PM -0500, Austad, Jay wrote: > > >Then have the script that does the mailing call randomly > > >on of the /var/qmail#/bin/qmail-inject. This will emulate round robin > > >without any patching. > > > > Won't this way be a performance hit though? I admit, it is an easy > solution > > No. My experience is that the cost of running a script to inject the mail > in a way similar to that mentioned above, is pretty small compared to the > queue injection cost and the delivery cost. sh or perl will be fine. > > > and would work excellent, but I have to think about efficiency also. C > code > > is much faster than shell or perl, and I'd like to set it up once and not > > have to ever worry about again, or at least for a long, long time. > > > > As I said, we're doing 50 million emails a month right now, but this is > > increasing substantially each month, and as we rollout new subscription > > services, we'll have even more load. Sending 10 times this amount by the > > same time next year is a good possibility, possibly sooner as we seem to > > underestimate the rate at which we're growing much of the time... > > You may also need to look at the scalability of the generation of the > emails. One system I recently looked at claimed to be able to generate > nicely unique emails at a targetted database, but it burned CPU like > it was free - just in generating the content. > > Mark. > > > > > Jay > > > > -----Original Message----- > > From: JuanE [mailto:[EMAIL PROTECTED]] > > Sent: Friday, July 14, 2000 5:55 PM > > To: '[EMAIL PROTECTED]' > > Subject: Re: questions about performance and setup > > > > > > > > Jay, > > > > That's the beauty of having multiple instances, not having to patch qmail. > > All you need to do is install qmail once per machine (ie, /var/qmail1, > > /var/qmail2,...). Then have the script that does the mailing call randomly > > on of the /var/qmail#/bin/qmail-inject. This will emulate round robin > > without any patching. > > > > JES > > > > Austad, Jay writes: > > > > > Where would I start in the code to modify the QMQP servers list so that > it > > > would load balance between all of the servers in the list instead of > just > > > using the first one it can contact? This would be very useful to me. I > > > assume qmail-qmqpc.c is one of them, are there others I would need to > play > > > around with? > > > > > > Jay > > > > > > -----Original Message----- > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > > > Sent: Friday, July 14, 2000 3:55 PM > > > To: '[EMAIL PROTECTED]' > > > Subject: Re: questions about performance and setup > > > > > > > > > On Fri, Jul 14, 2000 at 02:29:06PM -0500, Austad, Jay wrote: > > > > I already have Mandrake Linux 7.0 and 7.1 running on multiple Dell > boxes > > > > with no trouble, some of them took work to get going, but it runs > well. > > I > > > > have a few Crystal PC's here also that I may use instead, dual PIII > > 550's > > > > with 512MB ram and 9 or 18GB 10000rpm drives. I'll probably use these > > for > > > > testing. > > > > > > I agree with the earlier poster that more spindles for your queue > > > (c/- raid) is a good thing in general. > > > > > > > The bulk of the messages will be the same content to many rcpt's. > > > However, > > > > once in awhile we'll have 100,000 different messages go out to 100,000 > > > > different people. > > > > > > > > Since the QMQP support under mini-qmail doesn't load balance, can I > feed > > > it > > > > a hostname with multiple dns entries (round-robin dns)? Or better > yet, > > > how > > > > easy would it be to modify the qmail code to just load balance between > > > them? > > > > > > The manpage for qmail-qmqpc tells us that they have to be IP addresses > > > in qmqpservers so a RR DNS won't help. If all of the messages are > > generated > > > on one machine, then I'd be inclined to go for a much simpler solution > > > than modifying qmail. I'd have an instance of qmail for each outbound > > > server with the appropriate qmqpservers entry, then have your queue > > > insertion script do a round-robin itself by simply cycling thru > > > the qmail-inject command associated with each instance. > > > > > > for instance in 1 2 3 4 5 > > > do > > > getnext_message_details() > > > /var/qmail{$instance}/bin/qmail-inject currentmessage .... details > > > done > > > > > > Or some such. > > > > > > > > > Alternatively, if you have money to burn, maybe a layer four switch > > > with load-balancing skills. > > > > > > > > > Mark. > > > > > > > > > > > > > > Jay > > > > > > > > > > > > > > > > -----Original Message----- > > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > > > > Sent: Friday, July 14, 2000 2:09 PM > > > > To: '[EMAIL PROTECTED]' > > > > Subject: Re: questions about performance and setup > > > > > > > > > > > > > Here's what I need to know: > > > > > > > > > > 1. How well does qmail take advantage of multiple processors? How > > much > > > > > > > > Indreectly, quite well as it forks many processes, thus if the OS > takes > > > > good advantage of your CPUs, then qmail inherits that advantage. > > > > > > > > > memory and disk will I need? (we're at 50 million messages per > month > > > now, > > > > > > > > Are these message unique per target address or the same. If unique, > your > > > > requirements are vastly different and very queue/disk intensive. If > they > > > > are the same and you take advantage or VERP support on qmail, then > > > > your load will mainly be sending related which will benefit from > > > > more memory, multiple instances, etc. > > > > > > > > > and we only send out monday-friday, so that's over 2 million > messages > > > per > > > > > day, and it's only going up) > > > > > > > > > > 2. How many messages per day would one estimate that each of these > > > > servers > > > > > could do? > > > > > > > > > > 3. I read about mini-qmail and how it's about 100 times faster > > blasting > > > > out > > > > > email to QMQP servers. Since you can specify multiple QMQP servers, > > if > > > I > > > > > have a fourth machine running mini-qmail and managing the actual > > mailing > > > > > list, can I add the other 3 as QMQP servers and have it load balance > > > > between > > > > > all 3 for sending out mail? (this way I could add more servers > easily > > > if > > > > I > > > > > needed to) > > > > > > > > The qmqp support doesn't load balance. It simply takes the first one > > > > it can connect to. > > > > > > > > > 4. Can I easily make qmail run an external script for each bounced > > mail? > > > > > > > > Absolutely. > > > > > > > > > 5. Anything else I should know? > > > > > > > > That all hinges on whether your emails are unique for each recipient > or > > > > not. Or more importantly, the average number of recipients per unique > > > > email. > > > > > > > > > > > > Regards. > > > > > > >
On Mon, Jul 17, 2000 at 03:33:54PM +1000, Oliver White wrote: > We're in a similar situation at the moment. However, we want to send out > 100,000 UNIQUE emails per day, expanding to 500,000 or more in the near > future. Also, our send window is only actually a couple of hours. Is that for your TV stuff? 500K queue insertions and delivery (reliably) within 2-3 hours is a lot. I would not rely on one server, nor one point of internet connection. One thing that you may want to think about is the amount of bandwidth you will need. Let's see now, assuming a 10Kbyte message size (which is pretty close to the current average, especially if it's HTML)... 500,000 x 10,000 x 8 = 40000000000 bits. In two hours, that makes 20000000000 bits per hour, that makes 333333333 bits per minute, that makes 5555555 bits per second. Let's put some commas in to make this obvious: 5,555,555 In other words you'll need to pump out 5+ megabits per second, which means a connection of around double that, say 10 Mbits per second. Is that what you have available? Looking at the disk I/O, 500K queue insertions and deletions implies 1Million fsynced I/Os (one for insertion, one for delivery) in 2 hours, which means: 500000 fsynched I/Os per hour, that makes 8333 fsynched I/Os per minute, that makes 138 fsynched I/Os per second, that means that a 7ms access disk will be flat out. Again doubling it to make a safety margin means that you're looking at a disk subsystem that will give you an fsynced I/O rate of 3ms. Regards. > I'm trying to work out the best settings for the concurrencyremote and > conf-split parameters. Our system is a HP Netserver 2000r PIII-667 RAID5 > running Linux. Are there any problems in setting conf-split to a very large > value? Is it necessary on a Linux system, assuming a queue size of, say > 100,000? Any information appreciated. > > - Oliver. > > "Austad, Jay" wrote: > > > Non-unique emails will most likely be generated by other machines and send > > the box running mini-qmail via smtp. Non-unique emails will be a small > > percentage of what gets sent out, for now. > > > > Jay > > > > -----Original Message----- > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > > Sent: Saturday, July 15, 2000 12:10 AM > > To: '[EMAIL PROTECTED]' > > Subject: Re: questions about performance and setup > > > > On Fri, Jul 14, 2000 at 07:01:46PM -0500, Austad, Jay wrote: > > > >Then have the script that does the mailing call randomly > > > >on of the /var/qmail#/bin/qmail-inject. This will emulate round robin > > > >without any patching. > > > > > > Won't this way be a performance hit though? I admit, it is an easy > > solution > > > > No. My experience is that the cost of running a script to inject the mail > > in a way similar to that mentioned above, is pretty small compared to the > > queue injection cost and the delivery cost. sh or perl will be fine. > > > > > and would work excellent, but I have to think about efficiency also. C > > code > > > is much faster than shell or perl, and I'd like to set it up once and not > > > have to ever worry about again, or at least for a long, long time. > > > > > > As I said, we're doing 50 million emails a month right now, but this is > > > increasing substantially each month, and as we rollout new subscription > > > services, we'll have even more load. Sending 10 times this amount by the > > > same time next year is a good possibility, possibly sooner as we seem to > > > underestimate the rate at which we're growing much of the time... > > > > You may also need to look at the scalability of the generation of the > > emails. One system I recently looked at claimed to be able to generate > > nicely unique emails at a targetted database, but it burned CPU like > > it was free - just in generating the content. > > > > Mark. > > > > > > > > Jay > > > > > > -----Original Message----- > > > From: JuanE [mailto:[EMAIL PROTECTED]] > > > Sent: Friday, July 14, 2000 5:55 PM > > > To: '[EMAIL PROTECTED]' > > > Subject: Re: questions about performance and setup > > > > > > > > > > > > Jay, > > > > > > That's the beauty of having multiple instances, not having to patch qmail. > > > All you need to do is install qmail once per machine (ie, /var/qmail1, > > > /var/qmail2,...). Then have the script that does the mailing call randomly > > > on of the /var/qmail#/bin/qmail-inject. This will emulate round robin > > > without any patching. > > > > > > JES > > > > > > Austad, Jay writes: > > > > > > > Where would I start in the code to modify the QMQP servers list so that > > it > > > > would load balance between all of the servers in the list instead of > > just > > > > using the first one it can contact? This would be very useful to me. I > > > > assume qmail-qmqpc.c is one of them, are there others I would need to > > play > > > > around with? > > > > > > > > Jay > > > > > > > > -----Original Message----- > > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > > > > Sent: Friday, July 14, 2000 3:55 PM > > > > To: '[EMAIL PROTECTED]' > > > > Subject: Re: questions about performance and setup > > > > > > > > > > > > On Fri, Jul 14, 2000 at 02:29:06PM -0500, Austad, Jay wrote: > > > > > I already have Mandrake Linux 7.0 and 7.1 running on multiple Dell > > boxes > > > > > with no trouble, some of them took work to get going, but it runs > > well. > > > I > > > > > have a few Crystal PC's here also that I may use instead, dual PIII > > > 550's > > > > > with 512MB ram and 9 or 18GB 10000rpm drives. I'll probably use these > > > for > > > > > testing. > > > > > > > > I agree with the earlier poster that more spindles for your queue > > > > (c/- raid) is a good thing in general. > > > > > > > > > The bulk of the messages will be the same content to many rcpt's. > > > > However, > > > > > once in awhile we'll have 100,000 different messages go out to 100,000 > > > > > different people. > > > > > > > > > > Since the QMQP support under mini-qmail doesn't load balance, can I > > feed > > > > it > > > > > a hostname with multiple dns entries (round-robin dns)? Or better > > yet, > > > > how > > > > > easy would it be to modify the qmail code to just load balance between > > > > them? > > > > > > > > The manpage for qmail-qmqpc tells us that they have to be IP addresses > > > > in qmqpservers so a RR DNS won't help. If all of the messages are > > > generated > > > > on one machine, then I'd be inclined to go for a much simpler solution > > > > than modifying qmail. I'd have an instance of qmail for each outbound > > > > server with the appropriate qmqpservers entry, then have your queue > > > > insertion script do a round-robin itself by simply cycling thru > > > > the qmail-inject command associated with each instance. > > > > > > > > for instance in 1 2 3 4 5 > > > > do > > > > getnext_message_details() > > > > /var/qmail{$instance}/bin/qmail-inject currentmessage .... details > > > > done > > > > > > > > Or some such. > > > > > > > > > > > > Alternatively, if you have money to burn, maybe a layer four switch > > > > with load-balancing skills. > > > > > > > > > > > > Mark. > > > > > > > > > > > > > > > > > > Jay > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]] > > > > > Sent: Friday, July 14, 2000 2:09 PM > > > > > To: '[EMAIL PROTECTED]' > > > > > Subject: Re: questions about performance and setup > > > > > > > > > > > > > > > > Here's what I need to know: > > > > > > > > > > > > 1. How well does qmail take advantage of multiple processors? How > > > much > > > > > > > > > > Indreectly, quite well as it forks many processes, thus if the OS > > takes > > > > > good advantage of your CPUs, then qmail inherits that advantage. > > > > > > > > > > > memory and disk will I need? (we're at 50 million messages per > > month > > > > now, > > > > > > > > > > Are these message unique per target address or the same. If unique, > > your > > > > > requirements are vastly different and very queue/disk intensive. If > > they > > > > > are the same and you take advantage or VERP support on qmail, then > > > > > your load will mainly be sending related which will benefit from > > > > > more memory, multiple instances, etc. > > > > > > > > > > > and we only send out monday-friday, so that's over 2 million > > messages > > > > per > > > > > > day, and it's only going up) > > > > > > > > > > > > 2. How many messages per day would one estimate that each of these > > > > > servers > > > > > > could do? > > > > > > > > > > > > 3. I read about mini-qmail and how it's about 100 times faster > > > blasting > > > > > out > > > > > > email to QMQP servers. Since you can specify multiple QMQP servers, > > > if > > > > I > > > > > > have a fourth machine running mini-qmail and managing the actual > > > mailing > > > > > > list, can I add the other 3 as QMQP servers and have it load balance > > > > > between > > > > > > all 3 for sending out mail? (this way I could add more servers > > easily > > > > if > > > > > I > > > > > > needed to) > > > > > > > > > > The qmqp support doesn't load balance. It simply takes the first one > > > > > it can connect to. > > > > > > > > > > > 4. Can I easily make qmail run an external script for each bounced > > > mail? > > > > > > > > > > Absolutely. > > > > > > > > > > > 5. Anything else I should know? > > > > > > > > > > That all hinges on whether your emails are unique for each recipient > > or > > > > > not. Or more importantly, the average number of recipients per unique > > > > > email. > > > > > > > > > > > > > > > Regards. > > > > > > > > > > >
> We're in a similar situation at the moment. However, we want to send out > 100,000 UNIQUE emails per day, expanding to 500,000 or more in the near > future. Also, our send window is only actually a couple of hours. That shouldn't be too hard. With a Pentium 233 (not a P-II, a regular Pentium) attached to a 512k dsl line, using an IDE hard drive, I sent out 1,000 unique emails from a Perl script, the script took about 30 seconds to run, and all (deliverable) remote messages were delivered in about 45 seconds. That was with a concurrencyremote of 60. So, with equal hardware, 500,000 would take about 6 hours to run. Considering that you have about 10 times the CPU of the machine I used, and a much better disk, if you have a large enough pipe, you can turn the concurrencyremote to 200 (or even more), and it should work out in a couple of hours. steve
Hi folks, I'm new to managing bounces, so please bear with me. I've had a very tough time finding any good documentation which could guide me to building some scripts to parse through my bounces and semi-automate them. I do fairly large mailings at a time, and I'd like to properly manage my bounces. Basically, I'm curious to what everyone else is doing for managing bounces and if anyone has any good online documentation they could point me to. Any help would be appreciated. Thanks, Thomas
Hi, my ISP has changed the mailsystem so that I have to change my configuration too. They sent me an email in which they tell me to send my user-id and password when sending mail. They call it ESMTP. So far I used /usr/local/bin/maildirsmtp ~alias/pppdir alias-ppp- sendmail.neubert.com $IPADDR to send my mail. But if I try this now, I get the following error: maildirserial: info: new/963816027.832.chakoty bounced: 209.231.49.20 said: 553 To send mail, first check your mail with a valid POP account; this prevents unauthorized SPAM relaying. (#5.7.1) Does anybody know how to configure my site to use ESMTP? Kind regards, Tobias
Tobias Neubert a écrit : > /usr/local/bin/maildirsmtp ~alias/pppdir alias-ppp- sendmail.neubert.com > $IPADDR > to send my mail. But if I try this now, I get the following error: > maildirserial: info: new/963816027.832.chakoty bounced: 209.231.49.20 > said: 553 To send mail, first check your mail with a valid POP account; > this prevents unauthorized SPAM relaying. (#5.7.1) > Does anybody know how to configure my site to use ESMTP? This has nothing to do with ESMTP. Relaying is only allowed is you check your mail with POP before, to authenticate yourself. You can do it with fetchmail, before running maildirsmtp. Best regards, -- Frank DENIS aka Jedi/Sector One aka DJ Chrysalis <[EMAIL PROTECTED]> -> Software : http://www.jedi.claranet.fr <- If Bill Gates had a dime for every time a Windows box crashed... ...oh, wait a minute -- he already does.
Hi all: I use vpopmail+mysql+sqwebmail,and have installed vopopmail+mysql. i think it is ok. then there is some problem when i install sqwebmail. i run ./configure --enalbe-authvchkpw --without-authpam --without-authuserdb --without-authpwd --without-authshadow --enable-webpass=no then run make there is some error massage like this: ... /usr/local/vpopmail-4.8.4/vauth.c 537:undefined reference to 'mysql_free_result' /home/vpopmail/lib/libvpopmail.a vuth.o):infunction'vopen_smtp_relay': /usr/local/vpopmail-4.8.4/vauth.c 563:undefined reference to 'mysql_query' /usr/local/vpopmail-4.8.4/vauth.c 584:undefined reference to 'mysql_query' . . . make[1]:***[authvchkpw] Error 1 make:***[all-recursive] Error 1 /usr/local/vpopmail-4.8.4 is the path i unzip the tar file /home/vpopmail is the path i install even if i delete the path /usr/local/vpopmail-4.8.4 ,the error is the same. i think maybe mysql lib path is wrong, but i try to copy the mysql lib file to /usr/lib . but it is of no effect. Today i reinstall Redhat6.2+qmail+mysql+vpopmail, it is all ok. when i install sqwebmail, it is the same error. i am very vey anxious and will appreciate for ur help. pls reply asap. [EMAIL PROTECTED]
Hello, i have a problem i didn't find in the archive. I run qmail on solaris 2.6 and it works fine with one restriction. Every message sent with qmail or recieved with qmail gets a:" content length: 0" as body. I think the problem lies in the rc file i use but i can't find the mistake My rc file: #!/bin/sh # Using splogger to send the log through syslog. # Using dot-forward to support sendmail-style ~/.forward files. # Using binmail to deliver messages to /var/spool/mail/$USER by default. # Using BSD 4.4 binmail interface: /usr/libexec/mail.local -r exec env - PATH="/var/qmail/bin:$PATH" qmail-start '|dot-forward .forward \ |preline -f /usr/lib/mail.local -f "${SENDER:-MAILER-DAEMON}" "$USER"' \ splogger qmail Thanks for any sugestions in advance Georg Thoma -- Georg Thoma Tel. 0731/6020123 Suedblick 3 [EMAIL PROTECTED] 89075 Ulm