[vchkpw] Vdelivermail high load

2004-07-13 Thread Fernando Costa de Almeida

 Hi all,

 Today, when issuing a top on my pop server, I noticed that there were
some vdelivermails process eating a lot of cpu resources. Then, looking
in the logs files, I saw that it was a spam to a specific domain, and
this domain had the postmaster account as the 'catchall account'.
 
 What surprised me is the number of emails in the its Maildir: about
1479158 Is the number of emails in a Maildir related to the amount
of cpu vdelivermail uses? I saw an increasing use of the disc too,
somethings 100%...

 Thanks!


___
ALMEIDA, Fernando Costa de
Computeasy Informtica
www.computeasy.com.br
BSD USER BSD050945
ICQ 72293951



Re: [vchkpw] Vdelivermail high load

2004-07-13 Thread Jeremy Kitchen
On Tuesday 13 July 2004 09:47 am, Fernando Costa de Almeida wrote:
  Hi all,

  Today, when issuing a top on my pop server, I noticed that there were
 some vdelivermails process eating a lot of cpu resources. Then, looking
 in the logs files, I saw that it was a spam to a specific domain, and
 this domain had the postmaster account as the 'catchall account'.

  What surprised me is the number of emails in the its Maildir: about
 1479158 Is the number of emails in a Maildir related to the amount
 of cpu vdelivermail uses? I saw an increasing use of the disc too,
 somethings 100%...

if you're using ext2/3 filesystem, or any other non-directory hashing 
filesystem, this will occur.

This isn't vpopmail's fault, it's the filesystem.

You have two options, remove the emails, or switch to a better filesystem 
(such as reiserfs, or UFS with DIR_HASH)

for more details about this filesystem issue, please visit google, as this is 
discussed on more mailing lists than you could possibly think of.

-Jeremy

-- 
Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet Technologies, Inc.
  [EMAIL PROTECTED] ++ www.inter7.com ++ 866.528.3530 ++ 847.492.0470 int'l
kitchen @ #qmail #gentoo on EFnet ++ scriptkitchen.com/qmail



RE: [vchkpw] Vdelivermail high load

2004-07-13 Thread Fernando Costa de Almeida
Hi Jeremy, thanks for your explanation!

Im using FreeBSD and consequently an UFS Filesystem (with
DIR_HASH and SoftUpdates enabled). I will delete the emails, but I
posted this question just to make sure that my problem was caused by the
high number of files in the user's Maildir. The next step is to avoid
that an user have so many emails in his Maildir, perhaps enabling quota
for all users...

I frequently face high IO loads in this server, even though its
has one dedicated disk for the qmail queue and logs.

Thanks.


___
ALMEIDA, Fernando Costa de
Computeasy Informtica
www.computeasy.com.br
BSD USER BSD050945
ICQ 72293951

 -Original Message-
 From: Jeremy Kitchen [mailto:[EMAIL PROTECTED] 
 Sent: Tuesday, July 13, 2004 1:12 PM
 To: [EMAIL PROTECTED]
 Subject: Re: [vchkpw] Vdelivermail high load
 
 
 On Tuesday 13 July 2004 09:47 am, Fernando Costa de Almeida wrote:
   Hi all,
 
   Today, when issuing a top on my pop server, I noticed that 
 there were
  some vdelivermails process eating a lot of cpu resources. 
 Then, looking
  in the logs files, I saw that it was a spam to a specific 
 domain, and
  this domain had the postmaster account as the 'catchall account'.
 
   What surprised me is the number of emails in the its Maildir: about
  1479158 Is the number of emails in a Maildir related to 
 the amount
  of cpu vdelivermail uses? I saw an increasing use of the disc too,
  somethings 100%...
 
 if you're using ext2/3 filesystem, or any other non-directory hashing 
 filesystem, this will occur.
 
 This isn't vpopmail's fault, it's the filesystem.
 
 You have two options, remove the emails, or switch to a 
 better filesystem 
 (such as reiserfs, or UFS with DIR_HASH)
 
 for more details about this filesystem issue, please visit 
 google, as this is 
 discussed on more mailing lists than you could possibly think of.
 
 -Jeremy
 
 -- 
 Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet 
 Technologies, Inc.
   [EMAIL PROTECTED] ++ www.inter7.com ++ 866.528.3530 ++ 
 847.492.0470 int'l
 kitchen @ #qmail #gentoo on EFnet ++ scriptkitchen.com/qmail
 
 



RE: [vchkpw] Vdelivermail high load

2004-07-13 Thread Charles Sprickman
On Tue, 13 Jul 2004, Fernando Costa de Almeida wrote:

   Hi Jeremy, thanks for your explanation!

   Im using FreeBSD and consequently an UFS Filesystem (with
 DIR_HASH and SoftUpdates enabled). I will delete the emails, but I
 posted this question just to make sure that my problem was caused by the
 high number of files in the user's Maildir. The next step is to avoid
 that an user have so many emails in his Maildir, perhaps enabling quota
 for all users...

Another question...  Is there a quota on this account?  I've caught some
maildrop and vdelivermail processes chewing up a ton of cpu just trying to
recalculate the quota.  Very similar situation; catchalls are evil and
outdated.  Since the user had an incredibly huge quota anyway, I set them
to NOQUOTA with vmoduser and everything calmed down.

Thanks,

Charles

   I frequently face high IO loads in this server, even though its
 has one dedicated disk for the qmail queue and logs.

   Thanks.


 ___
 ALMEIDA, Fernando Costa de
 Computeasy Informtica
 www.computeasy.com.br
 BSD USER BSD050945
 ICQ 72293951

  -Original Message-
  From: Jeremy Kitchen [mailto:[EMAIL PROTECTED]
  Sent: Tuesday, July 13, 2004 1:12 PM
  To: [EMAIL PROTECTED]
  Subject: Re: [vchkpw] Vdelivermail high load
 
 
  On Tuesday 13 July 2004 09:47 am, Fernando Costa de Almeida wrote:
Hi all,
  
Today, when issuing a top on my pop server, I noticed that
  there were
   some vdelivermails process eating a lot of cpu resources.
  Then, looking
   in the logs files, I saw that it was a spam to a specific
  domain, and
   this domain had the postmaster account as the 'catchall account'.
  
What surprised me is the number of emails in the its Maildir: about
   1479158 Is the number of emails in a Maildir related to
  the amount
   of cpu vdelivermail uses? I saw an increasing use of the disc too,
   somethings 100%...
 
  if you're using ext2/3 filesystem, or any other non-directory hashing
  filesystem, this will occur.
 
  This isn't vpopmail's fault, it's the filesystem.
 
  You have two options, remove the emails, or switch to a
  better filesystem
  (such as reiserfs, or UFS with DIR_HASH)
 
  for more details about this filesystem issue, please visit
  google, as this is
  discussed on more mailing lists than you could possibly think of.
 
  -Jeremy
 
  --
  Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet
  Technologies, Inc.
[EMAIL PROTECTED] ++ www.inter7.com ++ 866.528.3530 ++
  847.492.0470 int'l
  kitchen @ #qmail #gentoo on EFnet ++ scriptkitchen.com/qmail
 
 




RE: [vchkpw] Vdelivermail high load

2004-07-13 Thread Fernando Costa de Almeida

 Yes!

 This account has a big quota (about 50MB)...
 
 Here is what I did:

 1) Deleted all emails from this account;
 2) Increased vfs.ufs.dirhash_maxmem to improve performance on big
directories (Thanks to Jeremy who mades me read more about DIRHASH)...
 

  And now, I will set the users to NOQUOTA (thanks to you, hehe)...

   

 
 Another question...  Is there a quota on this account?  I've 
 caught some
 maildrop and vdelivermail processes chewing up a ton of cpu 
 just trying to
 recalculate the quota.  Very similar situation; catchalls are evil and
 outdated.  Since the user had an incredibly huge quota 
 anyway, I set them
 to NOQUOTA with vmoduser and everything calmed down.
 
 Thanks,
 
 Charles
 
  I frequently face high IO loads in this server, even though its
  has one dedicated disk for the qmail queue and logs.
 
  Thanks.
 
 
  ___
  ALMEIDA, Fernando Costa de
  Computeasy Informtica
  www.computeasy.com.br
  BSD USER BSD050945
  ICQ 72293951
 
   -Original Message-
   From: Jeremy Kitchen [mailto:[EMAIL PROTECTED]
   Sent: Tuesday, July 13, 2004 1:12 PM
   To: [EMAIL PROTECTED]
   Subject: Re: [vchkpw] Vdelivermail high load
  
  
   On Tuesday 13 July 2004 09:47 am, Fernando Costa de Almeida wrote:
 Hi all,
   
 Today, when issuing a top on my pop server, I noticed that
   there were
some vdelivermails process eating a lot of cpu resources.
   Then, looking
in the logs files, I saw that it was a spam to a specific
   domain, and
this domain had the postmaster account as the 'catchall 
 account'.
   
 What surprised me is the number of emails in the its 
 Maildir: about
1479158 Is the number of emails in a Maildir related to
   the amount
of cpu vdelivermail uses? I saw an increasing use of 
 the disc too,
somethings 100%...
  
   if you're using ext2/3 filesystem, or any other 
 non-directory hashing
   filesystem, this will occur.
  
   This isn't vpopmail's fault, it's the filesystem.
  
   You have two options, remove the emails, or switch to a
   better filesystem
   (such as reiserfs, or UFS with DIR_HASH)
  
   for more details about this filesystem issue, please visit
   google, as this is
   discussed on more mailing lists than you could possibly think of.
  
   -Jeremy
  
   --
   Jeremy Kitchen ++ Systems Administrator ++ Inter7 Internet
   Technologies, Inc.
 [EMAIL PROTECTED] ++ www.inter7.com ++ 866.528.3530 ++
   847.492.0470 int'l
   kitchen @ #qmail #gentoo on EFnet ++ 
 scriptkitchen.com/qmail