Re: [Dovecot] lazy_expunge vs mulberry
On Sun, 2007-04-15 at 23:40 -0700, Frank Cusack wrote: I've configured the lazy_expunge plugin exactly like it says on the wiki. I can't seem to configure Mulberry to find the new namespaces. Any hints? I notice that the wiki says to use / as the separator. Mulberry has a setting for this, and the default is '.'. Leaving this as '.' in Mulberry and / in dovecot seems to work fine. (But I still can't access the .EXPUNGED or other namespaces.) Another page on the wiki says that the default separator for maildir is '.'. Why does the lazy_expunge page suggest using '/'? Well, the feature was developed for one specific user and that example configuration reflects how they wanted to use it. Or possibly the configuration I just happened to use while testing it. Or maybe it was an exact copy of how Cyrus's lazy expunges were explained. I don't remember. Your problem anyway is that hidden=yes makes the namespaces invisible to clients. I'll go remove them. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] keeping indexes in tmpfs
On Mon, 2007-04-16 at 09:37 -0400, Justin McAleer wrote: While doing some testing with converting accounts while simulating incoming mail load (no other pop/imap processes going but 4 processes converting users), we found that we were maxing out the local disk in the server with the index activity. To find out that it was the index activity, I mounted a tmpfs for dovecot to keep indexes on, and the system load dropped from 70 to 3 :) How exactly were you converting the users? I guess if the system is building new index files for tons of users that could take a while. fsync_disable=yes could help a lot with reducing the disk writes, and maybe also mmap_disable=yes. For Dovecot v2.0 I'm planning on reducing at least dovecot.index.log file sizes. I think currently it uses way too much space when building the initial indexes. Anyway, Timo and others, do you have any thoughts about keeping indexes on a tmpfs partition? I realize the obvious issues with this: running out of space, and the fact that the partition is lost on reboot. I think memory would be better used for keeping mailbox data cached that's actually useful at the time. Also if you've POP3 users who keep messages in the server and dovecot.index.cache file is lost, all the messages are read to calculate the messages' virtual sizes when the user logs in the next time. That could be expensive. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] timeout error in dovecot.log
On Mon, 2007-04-16 at 22:17 +0800, Joe Wong wrote: Hello, I have upgraded to Dovecot 1.0.0, I saw a lot of error in the dovecot.log file: Timeout while waiting for lock for transaction log file /fs/example.com/joewong/Maildir/dovecot.index.log where /fs is a NFS mounted directory. What can be the cause of this problem? How to prevent this from happening? What do you have in lock_method? Do you see anything else than timeout errors? Have you read http://wiki.dovecot.org/NFS? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] unknown user now logged - but auth works (Re: auth-login crash with cram-md5 (plain works) on unknown user)
more info with auth_debug=yes == /var/log/dovecot.info == dovecot: 2007-04-16 14:44:22 Info: Dovecot v1.0.rc32 starting up dovecot: 2007-04-16 14:44:27 Info: auth(default): client in: AUTH 1 CRAM-MD5 service=IMAPsecured lip=19.3.2.6 rip=19.8.5.23 dovecot: 2007-04-16 14:44:27 Info: auth(default): client out: CONT 1 PDg4Mjk2NzU1NTQwNjg1MTkuMTE3NjczNDY2N0BtYWlsLnBsYXlsb3VkZXIuY29tPg== dovecot: 2007-04-16 14:44:27 Info: auth(default): client in: CONThidden dovecot: 2007-04-16 14:44:27 Info: auth(default): ldap(yeled,19.8.5.23): pass search: base=ou=users,dc=playlouder,dc=com scope=subtree filter=((objectClass=CourierMailAccount)(uid=yeled)) fields=uid,userPassword dovecot: 2007-04-16 14:44:27 Info: auth(default): ldap(yeled,19.8.5.23): result: uid(user)=yeled userPassword(password)=hidden dovecot: 2007-04-16 14:44:27 Info: auth(default): client out: OK 1 user=yeled dovecot: 2007-04-16 14:44:27 Info: auth(default): master in: REQUEST 1 3880 1 dovecot: 2007-04-16 14:44:27 Info: auth(default): passwd(yeled,19.8.5.23): lookup dovecot: 2007-04-16 14:44:27 Info: auth(default): passwd(yeled,19.8.5.23): unknown user dovecot: 2007-04-16 14:44:27 Info: auth(default): ldap(yeled,19.8.5.23): user search: base=ou=users,dc=playlouder,dc=com scope=subtree filter=((objectClass=CourierMailAccount)(uid=yeled)) fields=homeDirectory,uidNumber,gidNumber dovecot: 2007-04-16 14:44:27 Info: auth(default): master out: USER 1 yeledhome=/home/y/yeled gid=5000uid=5000 dovecot: 2007-04-16 14:44:27 Info: IMAP(yeled): Effective uid=5000, gid=5000, home=/home/y/yeled dovecot: 2007-04-16 14:44:27 Info: IMAP(yeled): maildir: data=/home/y/yeled/Maildir dovecot: 2007-04-16 14:44:27 Info: IMAP(yeled): maildir: root=/home/y/yeled/Maildir, index=/home/y/yeled/Maildir, control=, inbox= dovecot: 2007-04-16 14:44:27 Info: imap-login: Login: user=yeled, method=CRAM-MD5, rip=19.8.5.23, lip=19.3.2.6, TLS dovecot -n: # /usr/local/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.info log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 ssl_cert_file: /etc/ssl/certs/mail.playlouder.com.pem ssl_key_file: /etc/ssl/private/mail.playlouder.com.key disable_plaintext_auth: no verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: mail.playlouder.com ready. login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 5000 last_valid_uid: 5000 first_valid_gid: 5000 last_valid_gid: 5000 mail_extra_groups: mail default_mail_env: maildir:~/Maildir mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle netscape-eoh delay-newmail imap_client_workarounds(imap): outlook-idle netscape-eoh delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %v-%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 cram-md5 apop verbose: yes passdb: driver: ldap args: /usr/etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /usr/etc/dovecot-ldap.conf socket: type: listen client: master: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix -- hail eris http://rubberduck.com/
Re: [Dovecot] unknown user now logged - but auth works (Re: auth-login crash with cram-md5 (plain works) on unknown user)
On Mon, 2007-04-16 at 15:46 +0100, Charlie Allom wrote: ldap(yeled,19.8.5.23): pass search: base=ou=users,dc=playlouder,dc=com scope=subtree filter=((objectClass=CourierMailAccount)(uid=yeled)) fields=uid,userPassword dovecot: 2007-04-16 14:44:27 Info: auth(default): ldap(yeled,19.8.5.23): result: uid(user)=yeled userPassword(password)=hidden yeled is found from LDAP passdb. passwd(yeled,19.8.5.23): unknown user Isn't found from passwd userdb. dovecot: 2007-04-16 14:44:27 Info: auth(default): ldap(yeled,19.8.5.23): user search: base=ou=users,dc=playlouder,dc=com scope=subtree filter=((objectClass=CourierMailAccount)(uid=yeled)) fields=homeDirectory,uidNumber,gidNumber Is again found from LDAP userdb, so the login succeeds. passdb: driver: ldap args: /usr/etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /usr/etc/dovecot-ldap.conf The lookups are done in this order. Is the userdb passwd supposed to be there at all? It's enough to find the user from one userdb. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] keeping indexes in tmpfs
Timo Sirainen wrote: On Mon, 2007-04-16 at 10:41 -0400, Justin McAleer wrote: OK, that also causes it to read the mailboxes and save the message sizes to cache files. I expected as much. But just to make sure we're on the same page, after converting a user, only dovecot.index and dovecot.index.log exist in a user's index directory, no dovecot.index.cache. However, all of the user's folders do have indexes, not just the inbox. That is the expected result, correct? And reading the mail spools? :) I have the source mail spools on NFS as well. It could be done pretty easily only for index files by modifying the sources. I guess another option should be added for this. Fair enough, I'll have a look at this if it does make a significant difference, although I'm trying to keep source changes minimal :) Depends on how mailboxes are accessed. If message contents are read only once then I guess it doesn't matter. Probably the worst offender here is SEARCH TEXT/BODY command. Understood... that's going to be nasty though, it's just a matter of degree :)
Re: [Dovecot] timeout error in dovecot.log
Hi Timo, the lock_method line is commented out in dovecot.conf file, and I have mmap_disable=yes. I don't see other error except this one. -- Joe - Original Message - From: Timo Sirainen [EMAIL PROTECTED] To: Joe Wong [EMAIL PROTECTED] Cc: dovecot@dovecot.org Sent: Monday, April 16, 2007 10:20 PM Subject: Re: [Dovecot] timeout error in dovecot.log
Re: [Dovecot] unknown user now logged - but auth works (Re: auth-login crash with cram-md5 (plain works) on unknown user)
On Mon, 16 Apr 2007 17:56:28 +0300, Timo Sirainen wrote:
On Mon, 2007-04-16 at 15:46 +0100, Charlie Allom wrote:
ldap(yeled,19.8.5.23): pass search: base=ou=users,dc=playlouder,dc=com
scope=subtree filter=((objectClass=CourierMailAccount)(uid=yeled))
fields=uid,userPassword
dovecot: 2007-04-16 14:44:27 Info: auth(default):
ldap(yeled,19.8.5.23): result: uid(user)=yeled
userPassword(password)=hidden
yeled is found from LDAP passdb.
passwd(yeled,19.8.5.23): unknown user
Isn't found from passwd userdb.
sorry timo - everyone :)
it was this
userdb passwd {
}
that i couldn't see because .. i've run out of excuses.
C.
--
hail eris
http://rubberduck.com/
Re: [Dovecot] mail_log plugin
On Mon, 2007-04-16 at 11:34 -0500, Phillip T. George wrote: Hello all, Is there any way to add additional options for the mail_log plugin? Specifically, I'm wanting to make it so IMAP copy commands will show the source filename http://dovecot.org/list/dovecot/2007-April/021617.html and/or the user's IP address. Add %r to mail_log_prefix setting. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Duplicate E-mail Problem
On Mon, 2007-04-16 at 13:21 -0500, Phillip T. George wrote: Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.177.64.93): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.168.68.56): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] It appears that the problem is that the user has two email programs running the same filters at the same time. Somehow, this creates a duplicate message. Any clues as to why this might be? Are there any options that may cause this behavior to change? I thought maybe the options maildir_copy_with_hardlinks and/or maildir_copy_preserve_filename may be helpful options...(they're both set to the default of 'no'). The message gets duplicated to Spam of course, but do you mean it also gets duplicated to INBOX? If you meant that they're duplicated in Spam, it just can't be helped. It's perfectly valid for an IMAP client to copy the same message twice to another mailbox. Set up a server-side filtering instead. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Duplicate E-mail Problem
Timo Sirainen wrote: On Mon, 2007-04-16 at 13:21 -0500, Phillip T. George wrote: Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.177.64.93): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.168.68.56): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] It appears that the problem is that the user has two email programs running the same filters at the same time. Somehow, this creates a duplicate message. Any clues as to why this might be? Are there any options that may cause this behavior to change? I thought maybe the options maildir_copy_with_hardlinks and/or maildir_copy_preserve_filename may be helpful options...(they're both set to the default of 'no'). The message gets duplicated to Spam of course, but do you mean it also gets duplicated to INBOX? If you meant that they're duplicated in Spam, it just can't be helped. It's perfectly valid for an IMAP client to copy the same message twice to another mailbox. Set up a server-side filtering instead. Its copied twice to Spam...its not in the INBOX any longer. Well...the duplicates were not a problem before when using courier-imap (though on a different server). I'm not too terribly concerned with the issue any longer, as the issue could very much considered client side. Thanks for the help! If you do have any other suggestions (or if anyone else does) on fixing the issue, I'd still like to know. -Phillip
Re: [Dovecot] Duplicate E-mail Problem
Phillip T. George wrote: Timo Sirainen wrote: On Mon, 2007-04-16 at 13:21 -0500, Phillip T. George wrote: Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.177.64.93): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.168.68.56): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] It appears that the problem is that the user has two email programs running the same filters at the same time. Somehow, this creates a duplicate message. Any clues as to why this might be? Are there any options that may cause this behavior to change? I thought maybe the options maildir_copy_with_hardlinks and/or maildir_copy_preserve_filename may be helpful options...(they're both set to the default of 'no'). The message gets duplicated to Spam of course, but do you mean it also gets duplicated to INBOX? If you meant that they're duplicated in Spam, it just can't be helped. It's perfectly valid for an IMAP client to copy the same message twice to another mailbox. Set up a server-side filtering instead. Its copied twice to Spam...its not in the INBOX any longer. Well...the duplicates were not a problem before when using courier-imap (though on a different server). I'm not too terribly concerned with the issue any longer, as the issue could very much considered client side. Thanks for the help! If you do have any other suggestions (or if anyone else does) on fixing the issue, I'd still like to know. -Phillip Oh..hmm. I may have left an important part of the log file out...it was previously grepped, but here it is, with the delete line in the middle: Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.177.64.93): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.177.64.93): deleted: uid=718, msgid=[EMAIL PROTECTED] Apr 16 12:51:45 east dovecot: IMAP(user.domain.com), IP(70.168.68.56): copy - Spam: uid=718, msgid=[EMAIL PROTECTED] The other important part is that there is not a delete after that, but the mail is not still in the inbox. So instead of copy, delete, copy, its actually of copy, copy, delete -- which is inconsistent with the log file. -Phillip
Re: [Dovecot] keeping indexes in tmpfs
Justin McAleer wrote: I have the source mail spools on NFS as well. Just asking - not looking for a flame war. I had a miserable time trying to get NFS working with just my simple LAN - I've had much better results via Samba with either SMBFS or CIFS. Off-topic - but can I ask why you're using NFS? -- Daniel
