Re: [vchkpw] Migration from 5.4.26 to 5.4.27

2009-04-22 Thread Matt Brookings
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Harm van Tilborg wrote:
> During the migration I've changed the hostname of the server, from
> mail.example.com to pop1.mail.example.com and pop2.mail.example.com. I
> can remember there were some problems from users by getting their mail
> (through qmail-pop3d). At that time, I've changed the server's hostname
> back to mail.example.com (at both servers), and every mail could be
> reached smoothly again by our customers.

The hostname of a system is not important, especially when dealing with
protocols for retrieving mail.

> Nowadays both servers are still called mail.example.com. However, I
> finally want to get rid of those names. So I was wondering what could
> have caused these problems?

Unfortunately, you haven't provided enough detail to even know what the
problems were, let alone enough to provide a possible solution.

> vdelivermail generates the mail's new filename, based on the hostname,
> process id, timestamp and perhaps the Maildir++'s 'S='. I was
> wondering whether any of the delivery agents (such qmail-pop3d or
> bincimap) makes use of the hostname to give out such mails.

qmail-pop3d is not a delivery agent, nor is bincimap.

> Or was this maybe a misbehavior of vpopmail around those version numbers.

The Maildir specification does not specify the format for message filenames,
it simply states they are unique.  How you arrive at a unique filename is
entirely up to the delivery process.  Processes reading these files, like
a POP3 or IMAP server, do not care what the filename is.

Therefore, unless vpopmail was trying to re-create the same filenames over
and over, there was no misbehavior in previous versions.
- --
/*
Matt BrookingsGnuPG Key D9414F70
Software developer Systems technician
Inter7 Internet Technologies, Inc. (815)776-9465
*/
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAknvG6YACgkQ6QgvSNlBT3DkRwCfTGbuFypRhfpMNlbA/X9EhLpI
S1cAoJASBFiuL1wvrjFzfjMBUUqhdcej
=b8wW
-END PGP SIGNATURE-


[vchkpw] Migration from 5.4.26 to 5.4.27

2009-04-22 Thread Harm van Tilborg

Hi there,

I'm preparing to migrate a server (hardware's getting old). Three years 
ago I've done the same thing (from 5.4.x with x < 10 to 5.4.13), 
however, the contents of the server were split over two different new 
servers. There were at that time some problems with migrating.


During the migration I've changed the hostname of the server, from 
mail.example.com to pop1.mail.example.com and pop2.mail.example.com. I 
can remember there were some problems from users by getting their mail 
(through qmail-pop3d). At that time, I've changed the server's hostname 
back to mail.example.com (at both servers), and every mail could be 
reached smoothly again by our customers.


Nowadays both servers are still called mail.example.com. However, I 
finally want to get rid of those names. So I was wondering what could 
have caused these problems?


vdelivermail generates the mail's new filename, based on the hostname, 
process id, timestamp and perhaps the Maildir++'s 'S='. I was 
wondering whether any of the delivery agents (such qmail-pop3d or 
bincimap) makes use of the hostname to give out such mails.


Or was this maybe a misbehavior of vpopmail around those version numbers.

--
Kind regards,
Harm van Tilborg

!DSPAM:49eeeb6832688535376948!



Re: [vchkpw] Migration using Rsync - Memory Problem

2005-10-28 Thread Rick Macdougall

Juan Enciso wrote:

Hello List.

I'm worried because my migration scheme is giving problems. My
migration plan was use rsync for transfer all user's mailbox, but it
don't work because my directory tree is very big. I have around 50K
maildir directory (110 GB approx).
I checked the rsync documentation and I note that it have memory
problems with big directory tree (It use a lot of memory and it does
shutdown my server).
I need transfer all the maildirs without turn off the mail service or
in any case, the time off of service should be short, for that reason
I did think use rsync, because it could make incremental copy.

Please, somebody know others alternative to rsync?


Hi,

Use rsync but with a script file that limits the number of files it does 
per pass.


ie

rsync vpopmail/domain.com/0 remote.example.com::vpopmail/domain.com/0
.
.
.

rsync vpopmail/domain.com/Z remote.example.com::vpopmail/domain.com/Z

Regards,

Rick



[vchkpw] Migration using Rsync - Memory Problem

2005-10-28 Thread Juan Enciso
Hello List.

I'm worried because my migration scheme is giving problems. My
migration plan was use rsync for transfer all user's mailbox, but it
don't work because my directory tree is very big. I have around 50K
maildir directory (110 GB approx).
I checked the rsync documentation and I note that it have memory
problems with big directory tree (It use a lot of memory and it does
shutdown my server).
I need transfer all the maildirs without turn off the mail service or
in any case, the time off of service should be short, for that reason
I did think use rsync, because it could make incremental copy.

Please, somebody know others alternative to rsync?

Bye


Re: Re: [vchkpw] migration

2005-06-17 Thread Scott Gamble
Slick!  

Wish I'd gotten this yesterday.  

D0H!

> - Original Message -
> Subject: Re: [vchkpw] migration
> From: Jeremy Kitchen <[EMAIL PROTECTED]>
> To: vchkpw@inter7.com
> Date: 06-17-2005 8:46 am
> 
> 
> On Thursday 16 June 2005 02:48 pm, Scott Gamble wrote:
> > This obviously poses something of a problem in terms of migration.  From
a
> > mysql install of vpopmail to a non-mysql install of vpopmail.
> >
> > First question - I'm going to have to recreate all these email accounts
by
> > hand aren't I...?
> 
> nope, look at ~vpopmail/bin/vconvert
> 
> > Second question - if we're going with a Non-Sql Integrated (NSI) version
of
> > vpopmail we're going to stick with it.  How does one migrate data from
one
> > NSI-vpopmail server to another?  How does it keep track of account
> > information if not with mysql?
> 
> it uses a passwd and passwd.cdb file in each domain's directory.
> 
> -Jeremy
> 
> -- 
> Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet Technologies,
Inc.
> [EMAIL PROTECTED] ++ inter7.com ++ 866.528.3530 ++ 815.776.9465 int'l
>   kitchen @ #qmail #gentoo on EFnet IRC ++ scriptkitchen.com/qmail
>  GnuPG Key ID: 481BF7E2 ++ jabber:[EMAIL PROTECTED]


Re: [vchkpw] migration

2005-06-17 Thread Jeremy Kitchen
On Thursday 16 June 2005 02:48 pm, Scott Gamble wrote:
> This obviously poses something of a problem in terms of migration.  From a
> mysql install of vpopmail to a non-mysql install of vpopmail.
>
> First question - I'm going to have to recreate all these email accounts by
> hand aren't I...?

nope, look at ~vpopmail/bin/vconvert

> Second question - if we're going with a Non-Sql Integrated (NSI) version of
> vpopmail we're going to stick with it.  How does one migrate data from one
> NSI-vpopmail server to another?  How does it keep track of account
> information if not with mysql?

it uses a passwd and passwd.cdb file in each domain's directory.

-Jeremy

-- 
Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet Technologies, Inc.
[EMAIL PROTECTED] ++ inter7.com ++ 866.528.3530 ++ 815.776.9465 int'l
  kitchen @ #qmail #gentoo on EFnet IRC ++ scriptkitchen.com/qmail
 GnuPG Key ID: 481BF7E2 ++ jabber:[EMAIL PROTECTED]


pgpH18mPcUmya.pgp
Description: PGP signature


[vchkpw] migration

2005-06-16 Thread Scott Gamble
Hey all

The servers I have now are Gentoo boxen - and we're migrating to Debian.

Following the qmailrocks guidelines, I've been able to bring everything up
on my Debian servers with a minimum amount of hassle, but my question
regards migration.

I was not able to bring vpopmail online with mysql integration on these
Debian machines - though vpopmail appears to work without it.  My Gentoo box
however, does use mysql.

This obviously poses something of a problem in terms of migration.  From a
mysql install of vpopmail to a non-mysql install of vpopmail.  

First question - I'm going to have to recreate all these email accounts by
hand aren't I...?

Second question - if we're going with a Non-Sql Integrated (NSI) version of
vpopmail we're going to stick with it.  How does one migrate data from one
NSI-vpopmail server to another?  How does it keep track of account
information if not with mysql?

Thanks everyone,
Scott Gamble


PS if someone wants to fill in the grey area of bringing vpopmail up with
mysql integration amidst this qmailrocks install, I'm sure that'd resolve
many of my issues and would be absolutely lovely - but I'm not officially
asking here for fear that I'll merely be shunted to the qmailrocks forum for
answers that don't appear to be forthcoming (I've already done that).


Re: [vchkpw] migration from 4.9 to 5.4+mysql

2004-10-01 Thread Eduardo Cortés
but authentication fail, what's wrong?
El Viernes, 1 de Octubre de 2004 17:32, Eduardo Cortés escribió:
> vconvert is the solution, sorry
>
> El Viernes, 1 de Octubre de 2004 16:52, Eduardo Cortés escribió:
> > Hi all,
> > I want to migrate some domains from vpopmail 4.9.10 (with cdb) to latest
> > 5.4 with mysql. On 5.2 versions, crypt passwords from 4.9 are valid on
> > new installations with md5, but on mysql it seems to fail (I has replaced
> > pw_passwd field with the encrypted password from vpasswd file and it fail
> > to auth), how can I migrate passwords from 4.9 to mysql? All passwords
> > are encrypted, any solution?
> > Regards,
> > Eduardo


Re: [vchkpw] migration from 4.9 to 5.4+mysql

2004-10-01 Thread Eduardo Cortés
vconvert is the solution, sorry
El Viernes, 1 de Octubre de 2004 16:52, Eduardo Cortés escribió:
> Hi all,
> I want to migrate some domains from vpopmail 4.9.10 (with cdb) to latest
> 5.4 with mysql. On 5.2 versions, crypt passwords from 4.9 are valid on new
> installations with md5, but on mysql it seems to fail (I has replaced
> pw_passwd field with the encrypted password from vpasswd file and it fail
> to auth), how can I migrate passwords from 4.9 to mysql? All passwords are
> encrypted, any solution?
> Regards,
> Eduardo


[vchkpw] migration from 4.9 to 5.4+mysql

2004-10-01 Thread Eduardo Cortés
Hi all,
I want to migrate some domains from vpopmail 4.9.10 (with cdb) to latest 5.4 
with mysql. On 5.2 versions, crypt passwords from 4.9 are valid on new 
installations with md5, but on mysql it seems to fail (I has replaced 
pw_passwd field with the encrypted password from vpasswd file and it fail to 
auth), how can I migrate passwords from 4.9 to mysql? All passwords are  
encrypted, any solution?
Regards,
Eduardo


Re: [vchkpw] Migration

2004-08-24 Thread Simon
Wanted to thank everyone for their help. I tarred /home/vpopmail/domains
updated the assign file and so far everything is working smoothly. I'll keep
you posted on how it goes. Thanks again.

Simon

- Original Message - 
From: "Dave Kettmann" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Monday, August 23, 2004 3:57 PM
Subject: RE: [vchkpw] Migration


> -Original Message-
> From: Jacob S. [mailto:[EMAIL PROTECTED]
> Sent: Monday, August 23, 2004 2:44 PM
> To: [EMAIL PROTECTED]
> Subject: Re: [vchkpw] Migration
>
>
> (quoting fixed)
>
> On Mon, 23 Aug 2004 14:35:27 -0500
> "Dave Kettmann" <[EMAIL PROTECTED]> wrote:
>
> > -Original Message-
> > From: Simon [mailto:[EMAIL PROTECTED]
> > Sent: Monday, August 23, 2004 2:08 PM
> > To: [EMAIL PROTECTED]
> > Subject: [vchkpw] Migration
> >
> >
> > Hello everyone,
> >
> > I am presently running. vpopmail 5.2.1 with qmailadmin 1.0.6. I have
> > just built a new box running vpopmail 5.4.0 and qmailadmin
> 1.2.0. The
> > new box is running without a problem. I would like to move
> my current
> > domains to the new box. I was planning on tarballing the domains
> > folder and then untarballing it on the new machine. I
> assume that its
> > not this simple any help would be appreciated.
>
> I believe this can work, but make sure that the path to
> ~vpopmail is the
> same on both servers. Also don't forget to copy your changes in
> /var/qmail/users/assign.
>
> > > It depends on how you are storing your passwords. I did a
> move from
> > > one machine to another (not sure what versions) and if qmailadmin
> > > and vpopmail are working fine on the new box, I had no
> problem just
> > > tarring up the mail structure (/home/vpopmail/*) and putting it on
> > > the new machine. Just dont forget to copy the passwords over :) I
> > > may be wrong in this, but it did seem to work for me. If I'm wrong
> > > .. someone please correct me.
>
> Don't you mean tarring the mail structure _/home/vpopmail/domains_?
> Simply tarring /home/vpopmail/* will will defeat his upgrade, as the
> vpopmail bin directory is part of what you just tarred.

Yes, I did mean that, sorry to confuse anyone. :-)

>
> HTH,
> Jacob
>
> -- 
> GnuPG Key: 1024D/16377135
>
> Random .signature #57:
> Windows NT encountered the following error: The operation completed
> successfully.
>



Re: [vchkpw] Migration

2004-08-24 Thread Dave Goodrich
Are you using MySQL? We have done this twice, in the middle of the 
second migration now.

If you have a lot of domains (over 100) getting the moved domains into 
the proper split is a concern. Example, you have 101 domains, domain 
99.com is in /home/vpopmail/domains/99.com. But your new server already 
has 20 domains. When you add domain 99.com it will be in 
/home/vpopmail/domains/0/99.com. See the problem? All your paths in 
vpasswd, assign, possibly your .qmail files will be wrong.

If you can script the edit process on assign, virtualdomains, 
morercpthosts, .qmail files, it is not too bad. This is what I have done 
both times.

My recommended processes if you don't have that many users/domains is to 
simply add the domains and users to the new system, point your DNS 
there. Once you confirm the new system is working then move the mail 
files over to their new home. This can be done easily by mounting the 
domains directory from the old server to the new server and copying the 
Maildir contents from the old Maildir to the new Maildir.

Keep in mind, vpopmail doesn't care what you do, the issue (if you don't 
use MySQL) is qmail. Keep thinking what you have to accomplish to make 
qmail happy and vpopmail will work just fine. I have found vuserinfo, 
vadduser, vadddomain, vmoduser, vpasswd to be very happy run from a script.

DAve
Simon wrote:
Hello everyone,
I am presently running. vpopmail 5.2.1 with qmailadmin 1.0.6. I have just built a new box running vpopmail 5.4.0 and qmailadmin 1.2.0. The new box is running without a problem. I would like to move my current domains to the new box. I was planning on tarballing the domains folder and then untarballing it on the new machine. I assume that its not this simple any help would be appreciated. 

Simon
--
Systems Administrator
http://www.tls.net
Get rid of Unwanted Emails...get TLS Spam Blocker!


RE: [vchkpw] Migration

2004-08-23 Thread Dave Kettmann
> -Original Message-
> From: Jacob S. [mailto:[EMAIL PROTECTED]
> Sent: Monday, August 23, 2004 2:44 PM
> To: [EMAIL PROTECTED]
> Subject: Re: [vchkpw] Migration
> 
> 
> (quoting fixed)
> 
> On Mon, 23 Aug 2004 14:35:27 -0500
> "Dave Kettmann" <[EMAIL PROTECTED]> wrote:
> 
> > -Original Message-
> > From: Simon [mailto:[EMAIL PROTECTED]
> > Sent: Monday, August 23, 2004 2:08 PM
> > To: [EMAIL PROTECTED]
> > Subject: [vchkpw] Migration
> > 
> > 
> > Hello everyone,
> >  
> > I am presently running. vpopmail 5.2.1 with qmailadmin 1.0.6. I have
> > just built a new box running vpopmail 5.4.0 and qmailadmin 
> 1.2.0. The
> > new box is running without a problem. I would like to move 
> my current
> > domains to the new box. I was planning on tarballing the domains
> > folder and then untarballing it on the new machine. I 
> assume that its
> > not this simple any help would be appreciated. 
> 
> I believe this can work, but make sure that the path to 
> ~vpopmail is the
> same on both servers. Also don't forget to copy your changes in
> /var/qmail/users/assign.
> 
> > > It depends on how you are storing your passwords. I did a 
> move from
> > > one machine to another (not sure what versions) and if qmailadmin
> > > and vpopmail are working fine on the new box, I had no 
> problem just
> > > tarring up the mail structure (/home/vpopmail/*) and putting it on
> > > the new machine. Just dont forget to copy the passwords over :) I
> > > may be wrong in this, but it did seem to work for me. If I'm wrong
> > > .. someone please correct me.
> 
> Don't you mean tarring the mail structure _/home/vpopmail/domains_?
> Simply tarring /home/vpopmail/* will will defeat his upgrade, as the
> vpopmail bin directory is part of what you just tarred.

Yes, I did mean that, sorry to confuse anyone. :-)

> 
> HTH,
> Jacob
> 
> -- 
> GnuPG Key: 1024D/16377135
> 
> Random .signature #57:
> Windows NT encountered the following error: The operation completed
> successfully.
> 


Re: [vchkpw] Migration

2004-08-23 Thread Jacob S.
(quoting fixed)

On Mon, 23 Aug 2004 14:35:27 -0500
"Dave Kettmann" <[EMAIL PROTECTED]> wrote:

> -Original Message-
> From: Simon [mailto:[EMAIL PROTECTED]
> Sent: Monday, August 23, 2004 2:08 PM
> To: [EMAIL PROTECTED]
> Subject: [vchkpw] Migration
> 
> 
> Hello everyone,
>  
> I am presently running. vpopmail 5.2.1 with qmailadmin 1.0.6. I have
> just built a new box running vpopmail 5.4.0 and qmailadmin 1.2.0. The
> new box is running without a problem. I would like to move my current
> domains to the new box. I was planning on tarballing the domains
> folder and then untarballing it on the new machine. I assume that its
> not this simple any help would be appreciated. 

I believe this can work, but make sure that the path to ~vpopmail is the
same on both servers. Also don't forget to copy your changes in
/var/qmail/users/assign.

> > It depends on how you are storing your passwords. I did a move from
> > one machine to another (not sure what versions) and if qmailadmin
> > and vpopmail are working fine on the new box, I had no problem just
> > tarring up the mail structure (/home/vpopmail/*) and putting it on
> > the new machine. Just dont forget to copy the passwords over :) I
> > may be wrong in this, but it did seem to work for me. If I'm wrong
> > .. someone please correct me.

Don't you mean tarring the mail structure _/home/vpopmail/domains_?
Simply tarring /home/vpopmail/* will will defeat his upgrade, as the
vpopmail bin directory is part of what you just tarred.

HTH,
Jacob

-- 
GnuPG Key: 1024D/16377135

Random .signature #57:
Windows NT encountered the following error: The operation completed
successfully.


pgpsJhb6X9uFi.pgp
Description: PGP signature


RE: [vchkpw] Migration

2004-08-23 Thread Dave Kettmann



Simon,
 
It 
depends on how you are storing your passwords. I did a move from one machine to 
another (not sure what versions) and if qmailadmin and vpopmail are working fine 
on the new box, I had no problem just tarring up the mail structure 
(/home/vpopmail/*) and putting it on the new machine. Just dont forget to copy 
the passwords over :) I may be wrong in this, but it did seem to work for me. If 
I'm wrong .. someone please correct me.
 
Dave 
Kettmann
NetLogic
636-561-0680

  -Original Message-From: Simon 
  [mailto:[EMAIL PROTECTED]Sent: Monday, August 23, 2004 2:08 
  PMTo: [EMAIL PROTECTED]Subject: [vchkpw] 
  Migration
  Hello everyone,
   
  I am presently running. vpopmail 5.2.1 with 
  qmailadmin 1.0.6. I have just built a new box running vpopmail 5.4.0 and 
  qmailadmin 1.2.0. The new box is running without a problem. I would like to 
  move my current domains to the new box. I was planning on tarballing the 
  domains folder and then untarballing it on the new machine. I assume that its 
  not this simple any help would be appreciated. 
   
  Simon


[vchkpw] Migration

2004-08-23 Thread Simon



Hello everyone,
 
I am presently running. vpopmail 5.2.1 with 
qmailadmin 1.0.6. I have just built a new box running vpopmail 5.4.0 and 
qmailadmin 1.2.0. The new box is running without a problem. I would like to move 
my current domains to the new box. I was planning on tarballing the domains 
folder and then untarballing it on the new machine. I assume that its not this 
simple any help would be appreciated. 
 
Simon


Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Tom Collins
On Jun 25, 2004, at 12:26 PM, Rick Macdougall wrote:
How are you running both qscanq and qmail-spamc ?
I modified qmail-spamc.c to run qmail-queue-real instead of 
qmail-queue.  It's also modified to not run spamc if RELAYCLIENT is set 
-- this way, mail sent by my users is not scanned.

I renamed /var/qmail/bin/qmail-queue to qmail-queue-real.
I built qscanq, but I don't think I installed it.
I have QMAILQUEUE set in my qmail-smtpd/run script:
export QMAILQUEUE='/package/mail/qscanq/command/qscanq'
So, qmail-smtpd runs qscanq (since QMAILQUEUE is set), qscanq runs 
/var/qmail/bin/qmail-queue (which is actually my qmail-spamc) which in 
turn runs spamc and the real qmail-queue.

You can download my modified qmail-spamc.c here:
  http://tomlogic.com/qmail/qmail-spamc.c
--
Tom Collins  -  [EMAIL PROTECTED]
QmailAdmin: http://qmailadmin.sf.net/  Vpopmail: http://vpopmail.sf.net/
Info on the Sniffter hand-held Network Tester: http://sniffter.com/


Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Rick Macdougall
Tom Collins wrote:
On Jun 25, 2004, at 11:54 AM, Jorge Valdes wrote:
I would replace qmail-scanner 1.21 with qmail-spamc (for SpamAssassin 
processing) and qscanq (for ClamAV virus filtering).  You would 
eliminate the Perl overhead of Qmail-Scanner and block incoming viruses 
at the qmail-smtpd level (cuts down on bounce message generation).  I 
have been extremely happy with the results.

Hi,
How are you running both qscanq and qmail-spamc ?
Regards,
Rick


Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Tom Collins
On Jun 25, 2004, at 11:54 AM, Jorge Valdes wrote:
I am running qmail-scanner 1.21, spamassassin 2.63(spamd), clamav 
0.70, File::Scan 1.15, also I have patched tcpserver to deny 
connections if the load average is greater than 12 or more than 5 
connections from the same IP address.  This alleviated the problem 
temporarily.
I would replace qmail-scanner 1.21 with qmail-spamc (for SpamAssassin 
processing) and qscanq (for ClamAV virus filtering).  You would 
eliminate the Perl overhead of Qmail-Scanner and block incoming viruses 
at the qmail-smtpd level (cuts down on bounce message generation).  I 
have been extremely happy with the results.

My knowledge of process accounting is limited, otherwise I'd try to 
recommend something that could report on how much processor time and 
swapping was caused by different programs.

If you don't have a lot of account adds/deletes/password-changes, then 
I'd think that going to CDB would be a good solution.  You'll cut down 
on the memory overhead of MySQL connections, and looking up users in 
the CDB file should have a lower overhead.

What's the maximum number of users you have in a domain?
--
Tom Collins  -  [EMAIL PROTECTED]
QmailAdmin: http://qmailadmin.sf.net/  Vpopmail: http://vpopmail.sf.net/
Info on the Sniffter hand-held Network Tester: http://sniffter.com/


Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Jorge Valdes
At 10:57 AM 25/06/2004, Greg Kopp wrote:
I doubt this is a MySQL problem. We are using MySQL in several
environments, including vpopmail. My guess is I don't have as many
users as you, since I set my pop3 concurency at 30 with no problems.
Are you running qmail-scanner or spamassassin? These added quite a bit
of load to my mail server (dual 2.8 Xeons, 2GB RAM) but it still
averages at around 0.3 for the 5min average. It will spike if Razor is
slow to respond or one of our customers does a blast e-mail to thier
client base.
You can try and put MySQL on a seperate server and just have vpopmail
connect to the external database and see if that solves any load
problems.
BTW, What versions are you running?
I cannot add more RAM to the server.. :(
I am running qmail-scanner 1.21, spamassassin 2.63(spamd), clamav 0.70, 
File::Scan 1.15, also I have patched tcpserver to deny connections if the 
load average is greater than 12 or more than 5 connections from the same IP 
address.  This alleviated the problem temporarily.

I have gathered the following average daily stats:
  438 IMAP connections0 Rejects due to load/maxip
28708 POP3 connections  308 Rejects due to load/maxip
 7355 SMTP connections  128 Rejects due to load/maxip
Bloquing:
   10 Emails due to policy reasons
 2923 Emails due to Virus
  595 Emails due to Spam > 15.0 pts.
   39.4% spam/ham ratio
Each instance of mysql  Ver 11.18 Distrib 3.23.58, for pc-linux (i686) uses
  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEM   TIME COMMAND
 1055 mysql  9   0 14500 9376 1152 S  0.0  1.8   4:28 mysqld
So when there are several concurrent POP3 connections, another instance of 
mysql is spawned to query the DB.  I think this is whats bringing the 
server to its knees...

In any case, has anyone done a MySQL to CDB migration?
--
Jorge Valdes
IT Manager
Intercom El Salvador
[EMAIL PROTECTED]
Tel. 503-278-5068
Tel. 503-265-7070
Fax. 503-265-7025 




Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Greg Kopp
I doubt this is a MySQL problem. We are using MySQL in several
environments, including vpopmail. My guess is I don't have as many
users as you, since I set my pop3 concurency at 30 with no problems.

Are you running qmail-scanner or spamassassin? These added quite a bit
of load to my mail server (dual 2.8 Xeons, 2GB RAM) but it still
averages at around 0.3 for the 5min average. It will spike if Razor is
slow to respond or one of our customers does a blast e-mail to thier
client base.

You can try and put MySQL on a seperate server and just have vpopmail
connect to the external database and see if that solves any load
problems.

BTW, What versions are you running?

On Fri, 25 Jun 2004 09:53:35 -0600, Jorge Valdes
<[EMAIL PROTECTED]> wrote:
> 
> Hi,
> 
> I have been having problems with resouce utilization with one of my qmail
> servers, which basically boils down to reaching the concurrencylimit of
> tcpserver for my pop3 connections (60) and this brings the server to its
> knees. The only recourse I have left is to reboot, since even console is
> not responsive.
> 
> I have checked my logs, and basically, for each pop3 connection, an
> instance of mysql is generated to check password for a virtual domain user,
> this generates swapping. The load average shoots up to 300 and I have seen
> this go as high as 500.
> 
> The server is running Linux RedHat 7.3 and has 512MB RAM and 1GB SWAP, for
> about 4000 users in 70 virtual domains. It also runs Apache for qmailadmin.
> Since there are not that many users per domain, less than 100 average, will
> CDB Files be a better solution to this problem?
> 
> Currently running vpopmail 5.3.19 and qmailadmin 1.0.15
> 
> 
> --
> Jorge Valdes
> IT Manager
> Intercom El Salvador
> [EMAIL PROTECTED]
> 
>


Re: [vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Tom Collins
On Jun 25, 2004, at 8:53 AM, Jorge Valdes wrote:
I have been having problems with resouce utilization with one of my 
qmail servers, which basically boils down to reaching the 
concurrencylimit of tcpserver for my pop3 connections (60) and this 
brings the server to its knees. The only recourse I have left is to 
reboot, since even console is not responsive.
What happens if you set concurrencylimit to 30?  Are people checking 
their email too often?  Is the problem that the POP3 users take a long 
time to download their email (on dialup)?

I have checked my logs, and basically, for each pop3 connection, an 
instance of mysql is generated to check password for a virtual domain 
user, this generates swapping. The load average shoots up to 300 and I 
have seen this go as high as 500.
Are you sure there isn't something else happening on the machine that 
pushes the load up?

The server is running Linux RedHat 7.3 and has 512MB RAM and 1GB SWAP, 
for about 4000 users in 70 virtual domains. It also runs Apache for 
qmailadmin. Since there are not that many users per domain, less than 
100 average, will CDB Files be a better solution to this problem?
Can this machine work with more memory?  You could add another 512M or 
even 1G of RAM and alleviate the problem.

I'm sorry, but I don't know whether switching to CDB will help with 
your problem.

--
Tom Collins  -  [EMAIL PROTECTED]
QmailAdmin: http://qmailadmin.sf.net/  Vpopmail: http://vpopmail.sf.net/
Info on the Sniffter hand-held Network Tester: http://sniffter.com/


[vchkpw] Migration from MySQL to CDB Files

2004-06-25 Thread Jorge Valdes
Hi,
I have been having problems with resouce utilization with one of my qmail 
servers, which basically boils down to reaching the concurrencylimit of 
tcpserver for my pop3 connections (60) and this brings the server to its 
knees. The only recourse I have left is to reboot, since even console is 
not responsive.

I have checked my logs, and basically, for each pop3 connection, an 
instance of mysql is generated to check password for a virtual domain user, 
this generates swapping. The load average shoots up to 300 and I have seen 
this go as high as 500.

The server is running Linux RedHat 7.3 and has 512MB RAM and 1GB SWAP, for 
about 4000 users in 70 virtual domains. It also runs Apache for qmailadmin. 
Since there are not that many users per domain, less than 100 average, will 
CDB Files be a better solution to this problem?

Currently running vpopmail 5.3.19 and qmailadmin 1.0.15
--
Jorge Valdes
IT Manager
Intercom El Salvador
[EMAIL PROTECTED]



[vchkpw] Migration of Mail.

2004-05-04 Thread Jeff Sorrentino
Hello, before I get flamed, I have read the prior posts on the 
Question, and all the answers differ ever so slightly.

I am moving server1 to server2, the following: Qmail utilizing Vpopmail.

1. What from Qmail do i need to preserve (IN SPECIFIC) to retain all 
queue info, as well as users.
2. What from vpopmail (if other than taring or rsync'ing the 
/usr/home/vpopmail structure) do I need to preserve?
3. After the basic directory hierarchy copies (preserving permissions 
and attributes/etc.), what utilities do i need to run to get everything 
back in sync?
4. Thank You for your time and help!

Jeff Sorrentino



[vchkpw] migration from oracle to mysql back-end

2004-04-29 Thread Ruslan Spivak
Hello.

Need your advice.
I have vpopmail 5.2.1 installed with oracle. Now i want to upgrade with
vpopmail 5.4.0 and move to mysql away from oracle(mysql is on the same
host where oracle and vpopmail).

oracle configure params were:

./configure \
--enable-md5-passwords=y \
--enable-clear-passwd=n \
--enable-default-domain=test.com \
--enable-oracle=y \
--enable-large-site=n \
--enable-passwd=n \
--enable-valias=y \
--enable-auth-logging=n

planning configure params for mysql:

./configure \
--disable-roaming-users \
--enable-logging=p \
--disable-ip-alias-domains \
--disable-passwd \
--enable-clear-passwd \
--disable-domain-quotas \
--enable-auth-module=mysql \
--disable-many-domains \
--enable-auth-logging \
--enable-mysql-logging \
--enable-valias \
--disable-mysql-limits \
--enable-mysql-replication \
--enable-md5-passwords \

and maybe:

--enable-learn-passwords


So from my previous oracle config i want to have some new different
things:
1) mysql back-end with --enable-auth-module=mysql
2) separate table per virtual domain instead of storing all users in
single table with --disable-many-domains
3) clear passwords for users in addition to md5 with
--enable-clear-passwd
4) auth and mysql logging: --enable-auth-logging and 
--enable-mysql-logging
5) mysq replication (planning to use this feature in near future)

My questions are:
1) How in my case migrate data stored in oracle db?

My thoughts are:
I need to create tables of following layout for each virtual domain with
corresponding names like 'test_com', 'master_test_com' and so on:
#define TABLE_LAYOUT "pw_name char(32) not null, \
pw_passwd char(40), \
pw_uid int, pw_gid int, \
pw_gecos char(48), \
pw_dir char(160), \
pw_shell char(20), \
pw_clear_passwd char(16), \
primary key (pw_name ) "

2) Default table in my oracle installation for default domain was
'vpopmail' for storing users. If now i want to use table per domain and
my default domain will be 'is.lg.ua' should i create table with above
layout and call it 'is_lg_ua' and put there clients with
pw_domain='is.lg.ua' from my oracle vpopmail table or users with default
domain will go to 'vpopmail' table in my mysql db?

3) is it ok to leave pw_clear_passwd_char empty in my mysql table for
old users, because in oracle vpopmail users have only md5 based
passwords?

4) so algorith of my migration script will be following(FIXME if i'm
missing something):
  a) in loop take record from oracle vpopmail table
  b) check pw_domain and create the table in mysql with the same
name(after mangling . and - to _) if it doesn't exists yet
  c) insert into mysql table values from oracle record leaving
pw_clear_passwd_char empty
  d) configure vpopmail 5.4.0 and install it into location of my
vpopmail 5.2.1

5) Are there any inricacies in changing auth-module from oracle to mysql
i should be aware of?

Any help is appreciated.
Thanks in advance.

Best regards,
Ruslan



[vchkpw] Migration Problems

2003-07-02 Thread Tom Walsh
We tried to migrate our mail server last night and everything was going
along well until we brought the new machine online.

We encountered a problem and I am not sure if it is a configuration option
or not, but I am looking for some guidance.

Our problem is when we migrated to the new server some of the mailboxes
weren't being delivered to.

We have maildirs in what appears to be two formats...

90% of the mailboxes are in the format of:

/usr/home/vpopmail/domains/domain.com/a/username/Maildir

but there are some mailboxes in the format of:

/usr/home/vpopmail/domains/domain.com/username/Maildir

Note the second one is missing the 0-9, A-Z directory structure.

We migrated from a 5.2.1 installation, to a 5.3.20 installation.

I don't know what the previous configuration options of vpopmail (5.2.1)
were, but the new one (5.3.20) was:

./configure  -enable-mysql=y -enable-default-domain=ala.net --enable-roaming
-users=y -enable-defaultquota=100
0 --enable-clear-passwd=n -enable-learn-passwords=y --enable-mysql-repli
cation=y -enable-logging=p --enable
-auth-logging=y -enable-mysql-logging=y --enable-many-domains=n

Is there some configuration option that I am missing? I noticed that there
is a --enable-domains-dir=domains configuration option but I don't know if
that directly applies to me or not. Or --enable-users-big-dir.

Any help you can send my way would be greatly appreciated.

Tom Walsh
Network Administrator
http://www.ala.net/





[vchkpw] migration and faq docs syndication feed

2003-06-18 Thread Toasterz Admin
hello vchkpw users:

well, progress on the migration and faq bits of the toasterz site
continues, albeit slowly.
one of the major issues of resistence i've come across is that we
developers, understandably, only want to maintain one version of our
documentation.  i believe that documentation should be consistent and
easy to maintain,  yet someghow distributed widely.  this seems a
perfect application for an rss feed or the like.
distributed documentation syndication is the goal. let's call it
really simple syndication for docs or rss-doc. any other suggestions?
make an xml doc publicly available and whomever can pick it up for 
inclusion in their content... easy to wrap in their look and feel etc.

my first thought is rss, but maybe something else makes more sense.  i'm
going to poke around more, but i thought i'd float the idea to the
community first.
regards,

Kelley Graham
toasterz.com





Re: [vchkpw] Migration of ~vpopmail/domains

2003-01-22 Thread Kiril Todorov
On Wed, Jan 22, 2003 at 08:58:23AM -0600, [EMAIL PROTECTED] wrote:
> I have been trying to move the ~vpopmail/domains directory to another
> server.  I did a tar --preserve-permissions -czf domains.tar.gz
> ~vpopmail/domains to tar up all of the domains directory, then scp'd it
> over to the other machine.  I untar'd it in ~vpopmail  I checked the
> archives and it said you need to copy over /var/qmail/control/* and
> /var/qmail/users/* which I have done.  I can log into qmailadmin, but
> once I'm logged in, I can't see any of the users.  I tried vuserinfo on
> several users, and they show up as not existing.  Did I miss any files
> in the transfer?  I thought I have them all but I might be missing
> something along the line.

Check if the id/gid of vpopmail/vchkpw match on the two boxes, and if needed
modify /var/qmail/users/asign with the correct one.
> 
> -- 
> Thanks,
> 
> Rob Burtelow
> [EMAIL PROTECTED]
> http://www.yewnicks.org
> 
> 
> 
> 
 Welcome.

-- 

Kiril Todorov   < -+- > +359 2 9712013
Bulgaria Online < -+- > http://home.online.bg

/* waiting... dreaming... wishing... */




[vchkpw] Migration of ~vpopmail/domains

2003-01-22 Thread [EMAIL PROTECTED]
I have been trying to move the ~vpopmail/domains directory to another
server.  I did a tar --preserve-permissions -czf domains.tar.gz
~vpopmail/domains to tar up all of the domains directory, then scp'd it
over to the other machine.  I untar'd it in ~vpopmail  I checked the
archives and it said you need to copy over /var/qmail/control/* and
/var/qmail/users/* which I have done.  I can log into qmailadmin, but
once I'm logged in, I can't see any of the users.  I tried vuserinfo on
several users, and they show up as not existing.  Did I miss any files
in the transfer?  I thought I have them all but I might be missing
something along the line.

-- 
Thanks,

Rob Burtelow
[EMAIL PROTECTED]
http://www.yewnicks.org