RE: [vchkpw] HUGE pop3 bottleneck
I use the Matt Simerson's awesome tcpserver/mysql patch to get around this problem. http://matt.simerson.net/computing/mail/qmail/ucspi-tcp-0.88-mysql.patch Regards, Paul Fries [EMAIL PROTECTED] -Original Message- From: Justin R. Miller [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 18, 2002 9:15 AM To: [EMAIL PROTECTED] Subject: [vchkpw] HUGE pop3 bottleneck -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I have just located a large source of problems with our installation. We average about 500 POP3 logins per minute and we had roaming users enabled. It seems that writing to the /usr/local/vpopmail/etc/open-smtp file was a large bottleneck since so many logins were attempting to write to the same file. Users would get file busy errors while successful logins, when they happened, would take upwards of a minute. Failures would happen instantly, since the file was not written to. Has anyone found an alternate solution to this? I now use authenticated SMTP only for this installation. Perhaps a directory of entries instead of a file, or some kind of file-based DB? Any ideas? We'd like to keep this feature, but with so many users, this seems to be the only system bottleneck on this system (about 13,000 domains). - -- [!] Justin R. Miller [EMAIL PROTECTED] Encrypted email preferred (key 0xC9C40C31) -BEGIN PGP SIGNATURE- Version: GnuPG v1.0.7 (FreeBSD) iD8DBQE9iKZ194d6K8nEDDERAo5GAJ45bcY0yWBNoU/9HORPLXOGxFFDwwCgktIi cDeeXrcqEHFTAJ0M9Ccuvg8= =ZocT -END PGP SIGNATURE-
[vchkpw] APOP/Learned Passwords
I have configured my system to enable learned passwords, and this is working as expected. Any user that logs in sets their password on the first authentication. However, I have noticed that users logging in with APOP are able to check their mail, but NO password is set in the database. Indeed they can put whatever they want in the password field, and they will still be allowed to check that POP box. I am using vpopmail 5.3.8 with --enable-roaming-users=y --enable-mysql=y --enable-clear-passwd=y --enable-learn-passwords=y Has anyone else experienced this? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
RE: [vchkpw] Using tcpserver/mysql
Thanks Matt. =) Yeah I have been really pulling my hair out over that one. =) With as many Pop-3 connections/sec that our servers handle I thought that I would make things a little smoother if Vpopmail didn't write the cdb. I am afraid that the hash would become corrupt and cause relay problems for my users. Instead, I am just having vpopmail write to a cdb elsewhere on the file system that nothing else reads. Then I have tcpserver read a different cdb file that I have created. It's messy, but it works. =) Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: Matt Simerson [mailto:[EMAIL PROTECTED]] Sent: Thursday, September 05, 2002 11:24 AM To: Paul Fries Cc: [EMAIL PROTECTED] Subject: Re: [vchkpw] Using tcpserver/mysql Paul, You are exactly correct. Even when using my patch, vpopmail continues to update the tcp.smtp.cdb file. There's one reason for that. The first is that my suggestion for adding a --dont-update-tcprulesfile=true was never implemented. Granted, it would only benefit a few users (really big ones like me) and it really doesn't make that much difference. So, in short you are right. You can do as I do and manually disable the routines in the vpopmail code that writes out the file, or you can just ignore it. If you're really clever, you can code in a --don't-update-tcprulesfile function but to save some time, you might want to search through the archives of this list as I've already been down that road. Matt On Tuesday, September 3, 2002, at 12:08 PM, Paul Fries wrote: Greetings, I am trying to accomplish using vpopmail with the tcpserver/mysql patch. Based on the documentation found on step 13 of http://www.inter7.com/vpopmail/INSTALL: -- For sites using the mysql module and --enable-roaming-users=y it is highly suggested to use Matt Simersons tcpserver-mysql patch. This removes the need for vpopmail to compile a tcp.smtp.cdb file for each pop authentication. -- I have implemented the patch, and verified that tcpserver is reading my /var/qmail/control/sql file properly (if I chmod 000 this file, tcpserver complains about it on startup). Also with --enable-roaming-users=y in vpopmail, vchkpw properly writes the authenticated IP addresses/timestamp to the vpopmail.relay table in MySQL. My problem is this: Even though it is properly writing the IPs to the vpopmail.relay table, it is also writing them into the tcp.smtp.cdb hash file. I would like it to ONLY write to MySQL and not to the .cdb. I have tried --enable-roaming-users=n, but this causes vchkpw to stop writing the IP addresses to either location. It is almost like there should be a --dont-update-tcprulesfile=true variable upon configuration. Am I missing something here? Has someone else configured vpopmail in this manner and gotten around this problem? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
RE: [vchkpw] Urgent Problem
Also, if you are trying to use Perl 5.8.0 with qmailscanner, you will receive the qq error. Downgrade to 5.6.1 to correct it. Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: Trey Nolen [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 04, 2002 6:04 AM To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: Re: [vchkpw] Urgent Problem qq errors are caused by qmailscanner, not vpopmail. Check your qmailscanner logs. You may be running out of memory (softlimits set too low). If you can't find anything in the logs, set the Debug variable to 1 in qmailscanner. There is information on this in the docs. Trey Nolen - Original Message - From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, September 03, 2002 10:57 PM Subject: [vchkpw] Urgent Problem Hi every one I have this issue that is stopping mail from being sent or received. RH 7.3 Vpop5.2 Qmail 1.03 Qmailadmin 1.0.2 This has happened before and I fixed it by cleaning files from the mail queue But no go this time. Will try and receive from outlook express as long as there is nothing in the mailbox. Trying to send just times out. If you try to send this from sqwebmail. You get error qmail-inject: fatal: qq read error Has any one come across any thing like this??? Any help would be appreciated. Regards Mick
RE: [vchkpw] Using tcpserver/mysql
;) Yep Doing that with the -S. That causes it to read the database. It is vchkpw that is updating the hash file. Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: slashboy [mailto:[EMAIL PROTECTED]] Sent: Tuesday, September 03, 2002 10:52 AM To: [EMAIL PROTECTED] Subject: RE: [vchkpw] Using tcpserver/mysql ChangeLog: v1.6 - SMTP relay table is entirely contained in a MySQL table. Previously the tcp.smtp.cdb file was still generated based upon the contents of a MySQL table. We have modified the tcpserver application to check a MySQL table (instead of a flat file) for each SMTP session to determine if a user's IP can relay or not. If the database connection fails, we allow the SMTP session anyway but don't allow relaying. Invoke tcpserver with the -S flag to utilize the new feature. :) -Original Message- From: Paul Fries [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 04, 2002 12:08 AM To: [EMAIL PROTECTED] Subject: [vchkpw] Using tcpserver/mysql Greetings, I am trying to accomplish using vpopmail with the tcpserver/mysql patch. Based on the documentation found on step 13 of http://www.inter7.com/vpopmail/INSTALL: -- For sites using the mysql module and --enable-roaming-users=y it is highly suggested to use Matt Simersons tcpserver-mysql patch. This removes the need for vpopmail to compile a tcp.smtp.cdb file for each pop authentication. -- I have implemented the patch, and verified that tcpserver is reading my /var/qmail/control/sql file properly (if I chmod 000 this file, tcpserver complains about it on startup). Also with --enable-roaming-users=y in vpopmail, vchkpw properly writes the authenticated IP addresses/timestamp to the vpopmail.relay table in MySQL. My problem is this: Even though it is properly writing the IPs to the vpopmail.relay table, it is also writing them into the tcp.smtp.cdb hash file. I would like it to ONLY write to MySQL and not to the .cdb. I have tried --enable-roaming-users=n, but this causes vchkpw to stop writing the IP addresses to either location. It is almost like there should be a --dont-update-tcprulesfile=true variable upon configuration. Am I missing something here? Has someone else configured vpopmail in this manner and gotten around this problem? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
RE: [vchkpw] Using tcpserver/mysql
Yep. Have that, and tcpserver is reading it properly. Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: slashboy [mailto:[EMAIL PROTECTED]] Sent: Tuesday, September 03, 2002 11:05 AM To: [EMAIL PROTECTED] Subject: RE: [vchkpw] Using tcpserver/mysql Hmm... One more thing I notice also, you will need a file /qmaildir/control/sql Content server sql.server port 3306 database vpopmail table relay user sqluser pass sqlpass time 1800 *Assuming mySQL using port 3306 :P correct me if I'm wrong -Original Message- From: Paul Fries [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 04, 2002 1:57 AM To: 'slashboy'; [EMAIL PROTECTED] Subject: RE: [vchkpw] Using tcpserver/mysql ;) Yep Doing that with the -S. That causes it to read the database. It is vchkpw that is updating the hash file. Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: slashboy [mailto:[EMAIL PROTECTED]] Sent: Tuesday, September 03, 2002 10:52 AM To: [EMAIL PROTECTED] Subject: RE: [vchkpw] Using tcpserver/mysql ChangeLog: v1.6 - SMTP relay table is entirely contained in a MySQL table. Previously the tcp.smtp.cdb file was still generated based upon the contents of a MySQL table. We have modified the tcpserver application to check a MySQL table (instead of a flat file) for each SMTP session to determine if a user's IP can relay or not. If the database connection fails, we allow the SMTP session anyway but don't allow relaying. Invoke tcpserver with the -S flag to utilize the new feature. :) -Original Message- From: Paul Fries [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 04, 2002 12:08 AM To: [EMAIL PROTECTED] Subject: [vchkpw] Using tcpserver/mysql Greetings, I am trying to accomplish using vpopmail with the tcpserver/mysql patch. Based on the documentation found on step 13 of http://www.inter7.com/vpopmail/INSTALL: -- For sites using the mysql module and --enable-roaming-users=y it is highly suggested to use Matt Simersons tcpserver-mysql patch. This removes the need for vpopmail to compile a tcp.smtp.cdb file for each pop authentication. -- I have implemented the patch, and verified that tcpserver is reading my /var/qmail/control/sql file properly (if I chmod 000 this file, tcpserver complains about it on startup). Also with --enable-roaming-users=y in vpopmail, vchkpw properly writes the authenticated IP addresses/timestamp to the vpopmail.relay table in MySQL. My problem is this: Even though it is properly writing the IPs to the vpopmail.relay table, it is also writing them into the tcp.smtp.cdb hash file. I would like it to ONLY write to MySQL and not to the .cdb. I have tried --enable-roaming-users=n, but this causes vchkpw to stop writing the IP addresses to either location. It is almost like there should be a --dont-update-tcprulesfile=true variable upon configuration. Am I missing something here? Has someone else configured vpopmail in this manner and gotten around this problem? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
RE: [vchkpw] Using tcpserver/mysql
That would keep tcpserver from reading the hash. However, vchkpw will still go about happily updating this file on every popauth even though nothing is reading it. Seems like a waste of CPU cycles to me. Also, I WANT tcpserver to read this file so that I can use it for blocking mail from abusive hosts, etc. I just do not want vchkpw to update it on every popauth. Paul J. Fries CWIE, LLC - Internet Services -Original Message- From: slashboy [mailto:[EMAIL PROTECTED]] Sent: Tuesday, September 03, 2002 10:47 AM To: 'Paul Fries' Subject: RE: [vchkpw] Using tcpserver/mysql Ooops I repeating what you said Maybe try running the tcpserver without -x /xxx/tcp.smtp.cdb option -Original Message- From: Paul Fries [mailto:[EMAIL PROTECTED]] Sent: Wednesday, September 04, 2002 12:08 AM To: [EMAIL PROTECTED] Subject: [vchkpw] Using tcpserver/mysql Greetings, I am trying to accomplish using vpopmail with the tcpserver/mysql patch. Based on the documentation found on step 13 of http://www.inter7.com/vpopmail/INSTALL: -- For sites using the mysql module and --enable-roaming-users=y it is highly suggested to use Matt Simersons tcpserver-mysql patch. This removes the need for vpopmail to compile a tcp.smtp.cdb file for each pop authentication. -- I have implemented the patch, and verified that tcpserver is reading my /var/qmail/control/sql file properly (if I chmod 000 this file, tcpserver complains about it on startup). Also with --enable-roaming-users=y in vpopmail, vchkpw properly writes the authenticated IP addresses/timestamp to the vpopmail.relay table in MySQL. My problem is this: Even though it is properly writing the IPs to the vpopmail.relay table, it is also writing them into the tcp.smtp.cdb hash file. I would like it to ONLY write to MySQL and not to the .cdb. I have tried --enable-roaming-users=n, but this causes vchkpw to stop writing the IP addresses to either location. It is almost like there should be a --dont-update-tcprulesfile=true variable upon configuration. Am I missing something here? Has someone else configured vpopmail in this manner and gotten around this problem? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
RE: [vchkpw] tcpserver mysql patch
Hmm. I tried that, but then the IP addresses are no longer written to my vpopmail/relay table in the MySQL database. -Original Message- From: Ken Jones [mailto:[EMAIL PROTECTED]] Sent: Saturday, August 31, 2002 9:25 AM To: Paul Fries; 'VpopMail Mailing List' Subject: Re: [vchkpw] tcpserver mysql patch the vchkpw program updates the tcp.smtp.cdb file. So you'll need to reconfigure vpopmail without roaming-users (the default is roaming users turned off). Ken Jones On Friday 30 August 2002 11:31 pm, Paul Fries wrote: Please forgive me if this is the wrong forum for this question. It seems that even after applying Matt Simerson's tcpserver-mysql patch, the tcp.smtp.cdb file is still being rehashed on every pop authentication. I am getting data in the relay table properly, and my /var/qmail/control/sql file is correct. Also, my qmail-smtpd/run file includes the -S flag to tcpserver. Does anyone know what I am missing here? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
[vchkpw] tcpserver mysql patch
Please forgive me if this is the wrong forum for this question. It seems that even after applying Matt Simerson's tcpserver-mysql patch, the tcp.smtp.cdb file is still being rehashed on every pop authentication. I am getting data in the relay table properly, and my /var/qmail/control/sql file is correct. Also, my qmail-smtpd/run file includes the -S flag to tcpserver. Does anyone know what I am missing here? Thanks! Regards, Paul Fries [EMAIL PROTECTED]
