Re: [vchkpw] Vpopmail mysql and aborted clients
sorry for insisting but this happens when courier enters, it's the same for pop, or imap or... in the moment courier enters in the play for imap only imagine because you use qmail-pop there in the way I told yesterday... after some time of inactivity happens this... sorry for insisting At 04.55 05/10/2007, you wrote: tonix (Antonio Nati) wrote: MysSQL has now an hardcoded timeout of eight hours. Courier uses it's authentication daemon with persistent attach to vpopmail/MySQL, it could be that during the night there are no requests, so MySQL connections are droppped (by MySQL). I thought this was addressed in a recent version of vpopmail? Yes, but you see in the logs that some connections have been dropped. Tonino Yep but wait a minute! if you have a machine in wich you only run qmail for mail scanning or smtp relay, or even with qmail-pop3d you don't get those aborted clients... but if you run there pop and imap with couier, so the problem occurs when you use courier... if you don't use it... you don't see any error... and both use vpopmail equally aren't they (courier and qmail) ? if you have for example qmail-smtpd with smtp auth only and of course vpopmail you will never have that errors... and you go to ask to courier and they say is a vpopmail question... but vpopmail works fine with qmail-smtpd!!! this was an important detail I forgot to tell yesterday... could this give you any more clue???
Re: [vchkpw] Vpopmail mysql and aborted clients
At 04.55 05/10/2007, you wrote: tonix (Antonio Nati) wrote: MysSQL has now an hardcoded timeout of eight hours. Courier uses it's authentication daemon with persistent attach to vpopmail/MySQL, it could be that during the night there are no requests, so MySQL connections are droppped (by MySQL). I thought this was addressed in a recent version of vpopmail? Yes, but you see in the logs that some connections have been dropped. Tonino Yep but wait a minute! if you have a machine in wich you only run qmail for mail scanning or smtp relay, or even with qmail-pop3d you don't get those aborted clients... but if you run there pop and imap with couier, so the problem occurs when you use courier... if you don't use it... you don't see any error... and both use vpopmail equally aren't they (courier and qmail) ? if you have for example qmail-smtpd with smtp auth only and of course vpopmail you will never have that errors... and you go to ask to courier and they say is a vpopmail question... but vpopmail works fine with qmail-smtpd!!! this was an important detail I forgot to tell yesterday... could this give you any more clue???
Re: [vchkpw] Vpopmail mysql and aborted clients
thanks a lot mates for you're answers, and in where logs could you see connections have been droped?? you doing an overview for all answers some mysql versions have timeout for it's persistent connections (connections as vpopmail connections) and this causes connection not to close properly and the aborted client... so then is a mysql issue?? could this cause problems? At 04.55 05/10/2007, you wrote: tonix (Antonio Nati) wrote: MysSQL has now an hardcoded timeout of eight hours. Courier uses it's authentication daemon with persistent attach to vpopmail/MySQL, it could be that during the night there are no requests, so MySQL connections are droppped (by MySQL). I thought this was addressed in a recent version of vpopmail? Yes, but you see in the logs that some connections have been dropped. Tonino
Re: [vchkpw] Vpopmail mysql and aborted clients
At 04.55 05/10/2007, you wrote: tonix (Antonio Nati) wrote: MysSQL has now an hardcoded timeout of eight hours. Courier uses it's authentication daemon with persistent attach to vpopmail/MySQL, it could be that during the night there are no requests, so MySQL connections are droppped (by MySQL). I thought this was addressed in a recent version of vpopmail? Yes, but you see in the logs that some connections have been dropped. Tonino
Re: [vchkpw] Vpopmail mysql and aborted clients
[EMAIL PROTECTED] wrote: sorry for insisting but this happens when courier enters, it's the same for pop, or imap or... in the moment courier enters in the play for imap only imagine because you use qmail-pop there in the way I told yesterday... after some time of inactivity happens this... sorry for insisting The problem does not really lie with courier. All qmail processes run under tcpserver and are only invoked when a connection appears. courier has this authdaemon that maintains persistent connections to mysql via the vpopmail library and so its behaviour is different from being run under tcpserver in qmail-smtpd or qmail-pop3d. This is why it appears that courier is the problem but it actually is not. It is just that courier has a different way of being run and this was not taken into account by vpopmail because none of the relevant qmail processes run persistently.
Re: [vchkpw] Vpopmail mysql and aborted clients
As told in other messages, the way of playing is different. Each vpopmail/qmail program usually executes brieftly and opens and closes MySQL, so there are no abnormal exits. When courier plays (both imap and pop), it asks auth data to courier's auth daemon. When this daemon is started, it opens MySQL and never closes it, as it supposes to reuse continuosly the same opened connection. But if none is going to use the connection for eigth hours, MySQL itself closes the connection. This will be opened again automatically by vpopmail library in courier's daemon, but you see an error in MySQL stats. Hope I've been clear. Tonino At 12.54 05/10/2007, [EMAIL PROTECTED] wrote: sorry for insisting but this happens when courier enters, it's the same for pop, or imap or... in the moment courier enters in the play for imap only imagine because you use qmail-pop there in the way I told yesterday... after some time of inactivity happens this... sorry for insisting At 04.55 05/10/2007, you wrote: tonix (Antonio Nati) wrote: MysSQL has now an hardcoded timeout of eight hours. Courier uses it's authentication daemon with persistent attach to vpopmail/MySQL, it could be that during the night there are no requests, so MySQL connections are droppped (by MySQL). I thought this was addressed in a recent version of vpopmail? Yes, but you see in the logs that some connections have been dropped. Tonino Yep but wait a minute! if you have a machine in wich you only run qmail for mail scanning or smtp relay, or even with qmail-pop3d you don't get those aborted clients... but if you run there pop and imap with couier, so the problem occurs when you use courier... if you don't use it... you don't see any error... and both use vpopmail equally aren't they (courier and qmail) ? if you have for example qmail-smtpd with smtp auth only and of course vpopmail you will never have that errors... and you go to ask to courier and they say is a vpopmail question... but vpopmail works fine with qmail-smtpd!!! this was an important detail I forgot to tell yesterday... could this give you any more clue???
[vchkpw] My single point of failure... failed
I got bit hard this morning and I am looking for a solution. I have been slowly getting our email system up to snuff moving from a pair of servers to two gateway AV scanners, three vpopmail toasters, and two outbound qmail servers. The toasters mount the Maildirs via NFS, the AV scanners talk to the toasters via milter-ahead, and the NFS mailstore hosts MySQL for vpopmail. I've just gotten load balancers installed and moved the outbound traffic there first, getting a good load test on vpopmaild for smtp-auth. I had promised to provide the scripts and now I am actually seeing how well they work. Problems arose when my NFS server went stupid this morning and all mail stopped. AV scanners couldn't verify mailboxes because the toasters couldn't see MySQL, the outbound servers couldn't do smtp-auth for the same reason. It wouldn't have mattered anyway because my Maildirs were offline. NFS is my single point of failure, even though it is RAID5, dual NIC, dual power supply (SUN Enterprise 250), it went offline. I need to fix that, I can cluster MySQL but I am looking for ways to have either a clustered NFS with rw permissions and appropriate locking/syncing, or NFS failover from the toasters. I am looking at GFS and active/active NFS and HaNFS. Has anyone gone down this path yet? Thanks, DAve -- Three years now I've asked Google why they don't have a logo change for Memorial Day. Why do they choose to do logos for other non-international holidays, but nothing for Veterans? Maybe they forgot who made that choice possible.
Re: [vchkpw] My single point of failure... failed
DAve wrote (at Fri, Oct 05, 2007 at 02:39:21PM -0400): I am looking at GFS and active/active NFS and HaNFS. Has anyone gone down this path yet? I haven't yet traveled this path, but I have strongly considered it. Please let us know what you come up with and how it works out. -- -- Casey Zacek Network Services NeoSpire, Inc. 1807 Ross Ave., Ste. 300 Dallas, TX 75201 www.neospire.net -- Managed Hosting Solutions P. 214-468-0768 F. 214-720-1836 --
Re: [vchkpw] My single point of failure... failed
Tren Blackburn wrote: Hi DAve; -Original Message- From: DAve [mailto:[EMAIL PROTECTED] Sent: Friday, October 05, 2007 11:39 AM To: vpopmail Subject: [vchkpw] My single point of failure... failed I got bit hard this morning and I am looking for a solution. I have been slowly getting our email system up to snuff moving from a pair of servers to two gateway AV scanners, three vpopmail toasters, and two outbound qmail servers. The toasters mount the Maildirs via NFS, the AV scanners talk to the toasters via milter-ahead, and the NFS mailstore hosts MySQL for vpopmail. I've just gotten load balancers installed and moved the outbound traffic there first, getting a good load test on vpopmaild for smtp-auth. I had promised to provide the scripts and now I am actually seeing how well they work. Problems arose when my NFS server went stupid this morning and all mail stopped. AV scanners couldn't verify mailboxes because the toasters couldn't see MySQL, the outbound servers couldn't do smtp-auth for the same reason. It wouldn't have mattered anyway because my Maildirs were offline. NFS is my single point of failure, even though it is RAID5, dual NIC, dual power supply (SUN Enterprise 250), it went offline. I need to fix that, I can cluster MySQL but I am looking for ways to have either a clustered NFS with rw permissions and appropriate locking/syncing, or NFS failover from the toasters. I am looking at GFS and active/active NFS and HaNFS. Has anyone gone down this path yet? I have. There's a couple ways of doing this. I've never played with GFS so I can't comment on that. The easiest solution I've found is doing an Active/Standby configuration between 2 nodes using DRBD to replicate the data in real time. There's quite a few solutions out there to handle resource seizure on node failure. If you want absolutely simple, go heartbeat v1. If you want to break your mailstore into 2 pieces (I have no idea how large of a mailstore you're working with. Mine is breaking 70G pretty soon) then you can do an Active/Active configuration using the High Availability manager from LinuxHA.net. I like that product mainly because it's written specifically for 2 node active/active clusters. And if you really want to muddy the waters, you can go with heartbeat v2 (I still have a bad taste in my mouth from it though) It's always best to keep major components on their own sets of boxen. My MySQL servers are a 2 node load balanced multi-master replicated pair. My Mailstore is a 2 node Active/Passive pair as described above (I cheat a bit and do some iSCSI exports on the passive box to the Windows people who demanded I share my storage with them. It's also handled by the HA software, so if the box exporting the iSCSI targets goes down, it shuffles across to the NFS box, and vice-versa) My inbound/outbound SMTP is across 4 dedicated load-balanced boxen. IMAP4(s)/POP3(s) is on its own pair and same with Web. If any of this seems useful to you let me know. No one should have to go through the nightmare of a key server going down. I hate getting yelled at. :) I am at least on the right or similar track. Here is some more background. Currently the gateways run MailScanner/sendmail/spamassassin/clamav/bitdefender, we have vpopmail/chkuser on the eclusters (toasters) providing pop and webmail, and the outbound servers provide smtp and smtp-auth (to become smtp-auth only) also running spamassassin and clamav via simscan. Everything sits behind a PIX and everything will eventually sit behind two Coyote Point EQ350si devices. Right now only the outbound servers are being load balanced. I am liking the look of HaNFS and DRDB but I have to look toward the future which involves sending half my mail system to a remote NOC. We have a dedicated 1GB fiber to provide a private LAN between the NOCs. My concern is over resyncing the mailstores after a fiber failure, which I KNOW will happen sooner or later. Not real sure if active/active or active/passive will be the best option, resyncing in general doesn't look inviting. My mailstore is only 60GB, few clients use webmail, most download everything all day. But it would certainly be a concern. When I setup MySQL as a cluster I will also be installing a local RO slave on each ecluster (toaster), just for auth purposes. I am assuming you found no problems running vpopmail/qmail on your mailstores? How do you handle failover? Any problems with qmail-local during deliveries? Thanks for the response. DAve -- Three years now I've asked Google why they don't have a logo change for Memorial Day. Why do they choose to do logos for other non-international holidays, but nothing for Veterans? Maybe they forgot who made that choice possible.
Re: [vchkpw] vpopmail user/group
aledr wrote: So... And If We ask the developers? Like me? :) It'll be very helpful for those intends to create RPMs if We could compile without check user / group... Version 6 will probably support runtime setting of the uid and gid. I don't believe there is any chance of it in version 5. We are designing version 6 on the [EMAIL PROTECTED] list right now. Rick
