Re: [Dovecot] Errors running imaptest with dovecot-1.1.1
El Martes, 1 de Julio de 2008 a las 19:42, Timo Sirainen escribió: These are actually all normal. I just haven't bothered to fix imaptest to treat different users' mailboxes as actual separate mailboxes. Since it assumes all the mailboxes are the one and same, it sees a lot of problems because they aren't. The multiuser support was written long before I added these checks and I haven't needed the multiuser testing myself for a long time, so this is broken for now. Feel free to fix it. :) Ok, thanks for the explanation. Unfortunately, my coding skills are far from optimal :) Also have you seen http://imapwiki.org/Benchmarking? imaptest tests best the webmail kind of a performance but not that much of Outlook/Thunderbird performance. Yes, i've read it. Our server load raised quite a lot since we switched our webmail from caching postman (http://www.uv.es/postman/postman.html) to non-caching imp, so non-caching tests are more important for us. Thanks. -- Joseba Torre. CIDIR Bizkaia. signature.asc Description: This is a digitally signed message part.
Re: [Dovecot] Errors running imaptest with dovecot-1.1.1
On Wed, 2008-07-02 at 09:25 +0200, Joseba Torre wrote: El Martes, 1 de Julio de 2008 a las 19:42, Timo Sirainen escribió: These are actually all normal. I just haven't bothered to fix imaptest to treat different users' mailboxes as actual separate mailboxes. Since it assumes all the mailboxes are the one and same, it sees a lot of problems because they aren't. The multiuser support was written long before I added these checks and I haven't needed the multiuser testing myself for a long time, so this is broken for now. Feel free to fix it. :) Ok, thanks for the explanation. Unfortunately, my coding skills are far from optimal :) Well, there's also an easy solution: ./imaptest 2/dev/null :) Also have you seen http://imapwiki.org/Benchmarking? imaptest tests best the webmail kind of a performance but not that much of Outlook/Thunderbird performance. Yes, i've read it. Our server load raised quite a lot since we switched our webmail from caching postman (http://www.uv.es/postman/postman.html) to non-caching imp, so non-caching tests are more important for us. Be sure to use sort=100 parameter then also to test sorting performance that's a lot better with v1.1. signature.asc Description: This is a digitally signed message part
[Dovecot] Using tags instead of folders?
Hi, currently most people store their messages in some sort of folder hierarchy, so that they can find them later easily. Here, for example, mails that are connected to a project are being stored in /CompanyName/ProjectNumber folders. Now I was wondering if there is any reason against using tags instead of a folder hierarchy, because tags are better when it comes to mails that belong to multiple projects (maybe even belonging to multiple companies) at once. All mails could then be stored in one folder/mailbox, fulltext search indexing would work well. You could search for a tag that consists of the ProjectNumber and would get all mails that belong to that project, just as if you would have opened that folder in the old hierarchy. You could save this search as a 'Search Folder' (talking in Thunderbird terms). Then I looked at how Thunderbird implements those tags when using IMAP. It stores them as IMAP keywords. Dovecot stores the first 26 flags in the filename, because it will only use one letter. Mapping between client's tag name and the letter is being done in dovecot-keywords files (one for each mailbox). If there are more IMAP keywords than 26, they will be stored in the dovecot.index file. (http://wiki.dovecot.org/MailboxFormat/Maildir) Now imagine we want to have 1000s (maybe 1s) of different tags (=IMAP keywords) - instead of folders. Can this be recommended? What happens if the index file gets corrupted for some reason? (I had to delete dovecot.index files before...). What happens if the Thunderbird profile breaks? What happens if we want to move on to another client? Are there other ways to implement 'tagging' instead of a hierarchy? Patrick. -- STAR Software (Shanghai) Co., Ltd.http://www.star-group.net/ Phone:+86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key: https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005 signature.asc Description: This is a digitally signed message part.
Re: [Dovecot] Using tags instead of folders?
On Wed, 2008-07-02 at 15:56 +0800, Patrick Nagel wrote: Then I looked at how Thunderbird implements those tags when using IMAP. It stores them as IMAP keywords. Dovecot stores the first 26 flags in the filename, because it will only use one letter. Mapping between client's tag name and the letter is being done in dovecot-keywords files (one for each mailbox). If there are more IMAP keywords than 26, they will be stored in the dovecot.index file. (http://wiki.dovecot.org/MailboxFormat/Maildir) Now imagine we want to have 1000s (maybe 1s) of different tags (=IMAP keywords) - instead of folders. Can this be recommended? Dovecot is currently optimized to handle a rather small number of keywords. They're stored as a bitmask, so using 1000 different keywords would use 125 bytes per each mail. If the keyword usage gets this high it would be a good idea to change the implementation to store them differently. You're also concentrating on only maildir format. Yes, there the limit is 26 keywords and I don't have plans to improve it. But for example with dbox format there is no such limit. What happens if the index file gets corrupted for some reason? (I had to delete dovecot.index files before...). v1.1 tries very hard to fix corrupted dovecot.index files and it also ignores errors in dovecot.index.log file. Also there have been rarely problems with those files. dovecot.index.cache file has been nearly always the problem and it can always be safely deleted. What happens if the Thunderbird profile breaks? What happens if we want to move on to another client? AFAIK Thunderbird currently supports only 5 keywords and it names them $Lablel1 .. $Label5. Not very portable. Are there other ways to implement 'tagging' instead of a hierarchy? With v1.2 it'll be possible to create virtual mailboxes. Each keyword could have its corresponding virtual mailbox. Pretty much like in gmail. signature.asc Description: This is a digitally signed message part
[Dovecot] auth-worker.18163) failed: Permission denied
Hi, I use a non-root user to run auth program and get an error: auth-worker.18163) failed: Permission denied and cannot start dovecot. But with the same configration at another server, it works fine. If I use root, it works also. Any help? Version: 1.1.1 Error log: dovecot: Jul 02 15:46:47 Fatal: auth(default): net_connect_unix(/home/xueron/var/run/dovecot/auth-worker.18163) failed: Permission denied dovecot: Jul 02 15:46:47 Fatal: Auth process died too early - shutting down Then I check the /home/xueron/var/run/dovecot/: srw-rw-rw- 1 amos amos0 Jul 2 15:46 auth-master srw--- 1 amosauth amosauth0 Jul 2 15:46 auth-worker.18163 srw--- 1 amosauth amosauth0 Jul 2 15:46 auth-worker.18164 srw--- 1 amosauth amosauth0 Jul 2 15:46 auth-worker.18165 srwxrwxrwx 1 root root0 Jul 2 15:46 dict-server drwxr-x--- 2 root amosdove 4096 Jul 2 15:46 login -rw--- 1 root root 43 Jul 2 15:46 master-fatal.lastlog -rw--- 1 root root6 Jul 2 15:46 master.pid the owner has already changed to the user i set in dovecot.conf Thanks! -- Xueron Nee http://www.xueron.com
[Dovecot] User changing password
If users are checking their email using imap or pop, is there a way they can change their own passwords (so I can create a temporary one and let them change them to whatever they want) through, say, Thunderbird or whatever?
[Dovecot] Dovecot Config Problem
Hello,
I am getting below error dovecot is not working..
--
[EMAIL PROTECTED] # dovecot -n | head -1
Error: Error in configuration file /usr/local/etc/dovecot.conf line 1:
Expecting '='
Fatal: Invalid configuration in /usr/local/etc/dovecot.conf
/usr/local/etc/dovecot.conf is as under:
---
# Basic Configuration
base_dir = /var/run/dovecot/
protocols = imap pop3
listen = *
disable_plaintext_auth = no
# Logging
log_path = /var/log/dovecot.log
info_log_path = /var/log/dovecot-info.log
# SSL
ssl_disable = yes
ssl_listen =
# Login Processes
login_dir = /var/run/dovecot/login
login_chroot = yes
login_process_size = 64
login_process_per_connection = yes
login_processes_count = 3
login_max_processes_count = 128
login_max_connections = 256
login_greeting = Dovecot ready
# Mailbox locations
mail_location = mbox:~/mail:INBOX=/var/mail/%u
# mail_location = maildir:~/Maildir
# mbox (Traditional)
mbox_read_locks = fcntl
mbox_write_locks = fcntl
# maildir (Latest)
# Mail Processes
max_mail_processes = 1024
mail_process_size = 256
mail_max_keyword_length = 50
# IMAP Specific Settings
protocol imap {
login_executable = /usr/libexec/dovecot/imap-login
mail_executable = /usr/libexec/dovecot/imap
mail_plugins =
mail_plugin_dir = /usr/lib/dovecot/imap
}
# POP3 specific settings
protocol pop3 {
login_executable = /usr/libexec/dovecot/pop3-login
mail_executable = /usr/libexec/dovecot/pop3
mail_executable = /usr/libexec/dovecot/pop3
}
# Authentication processes
auth_executable = /usr/libexec/dovecot/dovecot-auth
auth_process_size = 256
auth_realms =
auth_username_chars =
abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@
auth default {
mechanisms = plain login
passdb pam {
}
userdb passwd {
}
socket listen {
client {
# Assuming the default Postfix $queue_directory setting
path = /var/spool/postfix/private/auth
mode = 0660
# Assuming the default Postfix user and group
user = postfix
group = postfix
}
}
}
[Dovecot] Cant't get quota / dict work
Hi I have a mixed configuration for MAILDIR und MBOX accounts LDA is exim. For maildir exim writes a maildirsize file and I can see the IMAP contingent in my mailclient. But I can't find a solution for mbox. I tried dict with mysql, db, and pgsql - but notihing works for me. - db: a file is written but it seems to be empty: 1013 [mail] =db_dump-4.6 -p quota.db VERSION=3 format=print type=btree db_pagesize=4096 HEADER=END priv/quota/messages 0 priv/quota/storage 0 DATA=END - mysql: the dict-server connects, but nothing is written to the table dovecot: Jul 02 11:24:13 Info: dict: mysql: Connected to mail the mysql log shows no entries for an update or insert to the table quota - pgsql: same: the dict-server connects, but nothing is written to the table dovecot: Jul 02 10:56:45 Info: dict: pgsql: Connected to mail the pgsql log shows no activities System: FreeBSD 6.2-STABLE-200709 dict-quota.conf: connect = host= ... table = quota select_field = current where_field = path username_field = username Dovecot: 1027 [mail] =dovecot --version 1.1.1 1046 [mail] =dovecot --build-options Build options: ioloop=kqueue notify=kqueue openssl Mail storages: maildir mbox dbox cydir raw SQL drivers: mysql postgresql Passdb: checkpassword passwd passwd-file sql Userdb: checkpassword passwd prefetch passwd-file sql static 1047 [mail] =dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot log_path: /var/log/dovecot/dovecot info_log_path: /var/log/dovecot/dovecot protocols: imap imaps pop3 pop3s ... disable_plaintext_auth: no shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: W4W Dovecot ready. login_process_per_connection: no verbose_proctitle: yes first_valid_uid: 99 last_valid_uid: 99 first_valid_gid: 99 last_valid_gid: 99 mail_privileged_group: pop3 mail_location: mbox:/var/mbox/%u/mail:INBOX=/var/pop3/%u:INDEX=/var/ mbox/%u/indexes (for maildir values comes from database) mbox_write_locks: fcntl dotlock mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota expire autocreate mail_plugins(imap): quota imap_quota expire autocreate mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape- eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh dict_db_config: /usr/local/etc/dovecot/dovecot-db.conf auth default: mechanisms: plain login user: dovecot_auth verbose: yes passdb: driver: sql args: /usr/local/etc/dovecot/pgsql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot/pgsql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 plugin: autocreate: Sent autocreate2: Trash autocreate3: Drafts autocreate4: Junk autosubscribe: Sent autosubscribe2: Trash autosubscribe3: Drafts autosubscribe4: Junk expire: Trash 1 Trash/* 1 Junk 1 expire_dict: proxy:/var/run/dovecot/dict-server:expire quota: maildir quota2: dict:::proxy:/var/run/dovecot/dict-server:quota quota_rule: *:storage=20M quota_rule2: Trash:storage=10M quota_rule3: Spam:storage=20M quota_rule4: Junk:storage=20M quota2_rule: *:storage=20M quota2_rule2: Trash:storage=10M quota2_rule3: Spam:storage=20M quota2_rule4: Junk:storage=20M dict: expire: db:/usr/local/lib/dovecot/db/expire.db quota: mysql:/usr/local/etc/dovecot/dict-quota.conf or: quota: pgsql:/usr/local/etc/dovecot/dict-quota.conf or: quota = db:/usr/local/lib/dovecot/db/quota.db
Re: [Dovecot] sieve doesn't work with 1.1.1
Benjamin Andreas schreef:
Mail debug is now Enable but and don't see any errors
the .dovecot.sieve file in my home will be ignored
Dovecot v1.1.1 starting up
deliver(andreas): Jul 02 10:53:49 Info: maildir: data=/var/spool/imap/andreas
deliver(andreas): Jul 02 10:53:49 Info: maildir++:
root=/var/spool/imap/andreas, index=, control=,
inbox=/var/spool/imap/andreas
deliver(andreas): Jul 02 10:53:50 Info:
msgid=[EMAIL PROTECTED]:
saved mail to INBOX
Strange, it looks as though mail_debug is not doing anything or that the
cmusieve plugin is not loaded. Did you add it to mail_plugins under
protocol lda {} ? This is what my test server logs:
Jul 2 11:48:10 xi deliver(stephan): Loading modules from directory:
/usr/lib/dovecot/modules/lda
Jul 2 11:48:10 xi deliver(stephan): Module loaded:
/usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so
Jul 2 11:48:10 xi deliver(stephan): maildir: root exists
(/home/stephan/Maildir)
Jul 2 11:48:10 xi deliver(stephan): maildir++:
root=/home/stephan/Maildir, index=, control=, inbox=/home/stephan/Maildir
Jul 2 11:48:10 xi deliver(stephan): cmusieve: Using sieve path:
/home/stephan/.dovecot.sieve
Jul 2 11:48:10 xi deliver(stephan): cmusieve: Executing script
/home/stephan/.dovecot.sievec
Jul 2 11:48:11 xi deliver(stephan):
msgid=[EMAIL PROTECTED]: saved mail to INBOX
Regards,
Stephan
Re: [Dovecot] Poor pop3 over nfs performance
rc11 had this fix which may be relevant: - dovecot-uidlist is now recreated if it results in file shrinking over 25%. Not sure this fix is relevent; but I have upgraded to 1.1.1 With v1.1 INDEX=MEMORY shouldn't matter that much anymore, since it should cache the virtual message size to dovecot-uidlist. 1) Do you have ,W=size in maildir filenames? Apparently not? No; yesterday though I did switch exim to delivering through lda - surprisingly though there was not much effect on the graphs. 2) Do you have W=size added to dovecot-uidlist? I have found something here which I believe is a bug; will detail below 3) Are your POP3 users download + delete or do they leave mail on the server? A mixture; I believe at least 80% will download+delete; probably closer to 95% but we do have some very large mail stores - most of these would be accessed by a combination of pop and imap. You should be able to use dotlock_use_excl=yes. ... dotlock is the slowest locking method. Did you try how well fcntl would have worked? Not tried fcntl; I don't really trust nfs locking. I have enabled the excl in the config; again not much change. Now what I discovered in testing a particularly problematic user with an 800mb cur directory (under v1.1.1; I have never used v1.0 on this mbox but it was converted with your courier convert script); initially they had the following: drwx-- 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx-- 2 exim exim 499712 Jul 2 10:35 cur -rw--- 1 exim exim 20912 Jul 2 10:51 dovecot.index -rw--- 1 exim exim 33056 Jun 17 17:34 dovecot.index.cache -rw--- 1 exim exim 31336 Jul 2 10:37 dovecot.index.log -rw--- 1 exim exim 158465 Jul 2 10:13 dovecot-uidlist drwx-- 2 exim exim 4096 Jul 2 10:29 new -rw--- 1 exim exim 23 Jun 24 22:49 subscriptions drwx-- 2 exim exim 2048 Jul 2 10:42 tmp As you can see, the cache file is very old, and the uidlist file is behind the last time that the logged in (which was 10:35). When I log in over pop and do a stat/list, it re-reads everything in cur/new but didn't update the dovecot-uidlist file or the index.cache file (the log file is updated though). Dovecot-uidlist file does not have the extra W= tags in it. I removed the dovecot.index.cache file and performed the same login/stat/list operation and logged out, and suddenly the dovecot-uidlist file was updated to the new v1.1 format, and the directory listing looks like: total 1068 drwx-- 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx-- 2 exim exim 499712 Jul 2 10:35 cur -rw--- 1 exim exim 20912 Jul 2 10:53 dovecot.index -rw--- 1 exim exim 31428 Jul 2 10:53 dovecot.index.log -rw--- 1 exim exim 175508 Jul 2 10:53 dovecot-uidlist drwx-- 2 exim exim 4096 Jul 2 10:29 new -rw--- 1 exim exim 23 Jun 24 22:49 subscriptions drwx-- 2 exim exim 2048 Jul 2 10:42 tmp This looks like a bug to me; I will have a look in the source and see if I can find anything, but I thought I'd send this email as you'll be able to find the bug faster than I can. Thanks, Mark
[Dovecot] problem with expire plugin (dovecot 1.1.1)
Hi, i want to set up expire plugin with my dovecot configuration. host# dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins: expire mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: pam userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: expire: Trash 7 Trash/* 7 Spam 30 expire_dict: proxy::expire dict: expire: db:/var/lib/dovecot/expire.db host# dovecot --build-options Build options: ioloop=kqueue notify=kqueue openssl Mail storages: maildir mbox dbox cydir raw SQL drivers: Passdb: checkpassword pam passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file static ok, now i do: host# dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool Error: read(/var/run/dovecot/dict-server) failed: Illegal seek What's wrong with this? Best regards, p.
[Dovecot] Can't connect to auth server at /var/run/dovecot/auth-master: No such file or directory
Hello all. Just one quick stupid question. ;-( Im try to configure Exim + Dovecot 1.1.1 on FreeBSD 7.0 Then im try to send mail in logs im see this: deliver([EMAIL PROTECTED]): Jul 02 13:52:22 Error: Can't connect to auth server at /var/run/dovecot/auth-master: No such file or directory %ls -al /var/run/dovecot/* srw-rw 1 exim wheel /var/run/dovecot/auth-client srw--- 1 dovecot-auth wheel /var/run/dovecot/auth-master srw--- 1 dovecot-auth dovecot-auth /var/run/dovecot/auth-worker.6512 srwxrwxrwx 1 root wheel /var/run/dovecot/dict-server -rw--- 1 root wheel /var/run/dovecot/master.pid As im can understand im confused at Dovecot permission system. Please tell me what im must fix. Here is my config: %dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot.log protocols: imap imaps pop3s ssl_cert_file: /usr/local/etc/certs/cert.crt ssl_key_file: /usr/local/etc/certs/cert.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_processes_count: 5 mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 3 verbose_proctitle: yes first_valid_uid: 1025 first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location: maildir:/var/spool/dovecot/domains/%d/%n/ mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login cram-md5 digest-md5 user: dovecot-auth username_format: %Lu passdb: driver: pam passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot-auth -- Best Regards, Proskurin Kirill
Re: [Dovecot] Poor pop3 over nfs performance
In case anyone else is experiencing this issue, using the following in a postlogin script is a reasonable workaround: if [[ ! -e $HOME/.lastlogin_imap $HOME/Maildir/dovecot.index.cache -ot $HOME/Maildir/new $HOME/Maildir/dovecot-uidlist -ot $HOME/Maildir/new ]]; then rm -f $HOME/Maildir/dovecot.index.cache fi (whenever a user logs in via imap we touch .lastlogin_imap, so we only kill the cache file if the user is pop3-only and both the cache and uidlist are older than the new directory). Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Mark Zealey Sent: 02 July 2008 11:01 To: Dovecot Mailing List Subject: Re: [Dovecot] Poor pop3 over nfs performance rc11 had this fix which may be relevant: - dovecot-uidlist is now recreated if it results in file shrinking over 25%. Not sure this fix is relevent; but I have upgraded to 1.1.1 With v1.1 INDEX=MEMORY shouldn't matter that much anymore, since it should cache the virtual message size to dovecot-uidlist. 1) Do you have ,W=size in maildir filenames? Apparently not? No; yesterday though I did switch exim to delivering through lda - surprisingly though there was not much effect on the graphs. 2) Do you have W=size added to dovecot-uidlist? I have found something here which I believe is a bug; will detail below 3) Are your POP3 users download + delete or do they leave mail on the server? A mixture; I believe at least 80% will download+delete; probably closer to 95% but we do have some very large mail stores - most of these would be accessed by a combination of pop and imap. You should be able to use dotlock_use_excl=yes. ... dotlock is the slowest locking method. Did you try how well fcntl would have worked? Not tried fcntl; I don't really trust nfs locking. I have enabled the excl in the config; again not much change. Now what I discovered in testing a particularly problematic user with an 800mb cur directory (under v1.1.1; I have never used v1.0 on this mbox but it was converted with your courier convert script); initially they had the following: drwx-- 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx-- 2 exim exim 499712 Jul 2 10:35 cur -rw--- 1 exim exim 20912 Jul 2 10:51 dovecot.index -rw--- 1 exim exim 33056 Jun 17 17:34 dovecot.index.cache -rw--- 1 exim exim 31336 Jul 2 10:37 dovecot.index.log -rw--- 1 exim exim 158465 Jul 2 10:13 dovecot-uidlist drwx-- 2 exim exim 4096 Jul 2 10:29 new -rw--- 1 exim exim 23 Jun 24 22:49 subscriptions drwx-- 2 exim exim 2048 Jul 2 10:42 tmp As you can see, the cache file is very old, and the uidlist file is behind the last time that the logged in (which was 10:35). When I log in over pop and do a stat/list, it re-reads everything in cur/new but didn't update the dovecot-uidlist file or the index.cache file (the log file is updated though). Dovecot-uidlist file does not have the extra W= tags in it. I removed the dovecot.index.cache file and performed the same login/stat/list operation and logged out, and suddenly the dovecot-uidlist file was updated to the new v1.1 format, and the directory listing looks like: total 1068 drwx-- 2 exim exim 2048 Apr 11 2007 courierimapkeywords -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist drwx-- 2 exim exim 499712 Jul 2 10:35 cur -rw--- 1 exim exim 20912 Jul 2 10:53 dovecot.index -rw--- 1 exim exim 31428 Jul 2 10:53 dovecot.index.log -rw--- 1 exim exim 175508 Jul 2 10:53 dovecot-uidlist drwx-- 2 exim exim 4096 Jul 2 10:29 new -rw--- 1 exim exim 23 Jun 24 22:49 subscriptions drwx-- 2 exim exim 2048 Jul 2 10:42 tmp This looks like a bug to me; I will have a look in the source and see if I can find anything, but I thought I'd send this email as you'll be able to find the bug faster than I can. Thanks, Mark
Re: [Dovecot] Dovecot Config Problem
On 7/2/2008, Kaushal Gandhi ([EMAIL PROTECTED]) wrote: [EMAIL PROTECTED] # dovecot -n | head -1 Error: Error in configuration file /usr/local/etc/dovecot.conf line 1: Expecting '=' Fatal: Invalid configuration in /usr/local/etc/dovecot.conf Are you by any chance editing the config file from a windows client? The only thing I can think of is a windows==unix file format issue... -- Best regards, Charles
Re: [Dovecot] User changing password
On 7/2/2008 5:06 AM, Mauricio Tavares wrote: If users are checking their email using imap or pop, is there a way they can change their own passwords (so I can create a temporary one and let them change them to whatever they want) through, say, Thunderbird or whatever? Not through Thunderbird, but maybe through 'whatever'... password change is not a function of the client or of dovecot, at least not without some kind of plug-in or extension... -- Best regards, Charles
[Dovecot] DBox questions - WAS: Re: Using tags instead of folders?
On 7/2/2008, Timo Sirainen ([EMAIL PROTECTED]) wrote: You're also concentrating on only maildir format. Yes, there the limit is 26 keywords and I don't have plans to improve it. But for example with dbox format there is no such limit. Cool! But three dbox questions: 1. Do you consider dbox to be ready for prime time, in a production environment? 2. Related to first question - do you foresee any major changes to its internals, that would result in potentially painful updates in the future, for anyone desiring to use it in production now? and 3. Where is documentation on configuration settings? There is nothing on the wiki under Mailbox location configuration where maildir and mbox are specifically discussed, I only found one page where it is mentioned (Mailbox formats), and its own page, but there is nothing about actual configuration settings. The only caveat I can surmise is that, since nothing else [currently] supports dbox format except dovecot, you'd have to use dovecot's LDA - which is not a problem, actually desirable for index updates, but it would be good to see some official docs on how to set it [dbox] up correctly. Tia Timo, -- Best regards, Charles
Re: [Dovecot] Using tags instead of folders?
On 7/2/2008 4:23 AM, Timo Sirainen wrote: With v1.2 it'll be possible to create virtual mailboxes. Each keyword could have its corresponding virtual mailbox. Pretty much like in gmail. I'm curious about how this will be controlled from the users/client standpoint? I'm guessing there would have to be some kind of support in the client to be able to create/define/manipulate the virtual folders? Hopefully an extension could be created in Thunderbird to do this... maybe even with a little help from Grand Master Timo (since you are most familiar with the best way for a client to talk to dovecot)? ;) Thanks Timo... 1.1.x is really working well... so much better than 1.0.x - which was already so much better than courier-imap. I'm still trying to convince my biggest client to let me change them over to dovecot - but when they finally let me, they're gonna love the difference... -- Best regards, Charles
[Dovecot] OT - Legal disclaimers - WAS: Re: Poor pop3 over nfs performance
On 7/2/2008, Mark Zealey ([EMAIL PROTECTED]) wrote: This mail is subject to http://www.gxn.net/disclaimer Wow... good idea for disclaimers (I hate them)... I wonder if doing it this way fulfills the brain-dead laws requiring disclaimers some countries are enacting? -- Best regards, Charles
Re: [Dovecot] Errors running imaptest with dovecot-1.1.1
Just if someone is interested, here are initial results. Common settings: RHEL4, dual Intel(R) Xeon(TM) CPU 2.40GHz, 2GB RAM. NFS mounted homes (using EMC celerra), local index files, NFS mounted control files. Authentication uses PAM and local files. FS quota enabled. (dovecot -n output added at the bottom) - dovecot v1.0.13 compiled with --with-ldap, RHEL4. Command run $ imaptest user=imaptest%03d pass=paquitoelchocolatero mbox=dovecot.mbox clients=50 seed=321 sort=100 secs=100 2 /dev/null Totals: Logi List Stat Sele Fetc Fet2 Sort Stor Dele Expu Appe Logo 100% 50% 50% 100% 100% 100% 100% 50% 100% 100% 100% 100% 30% 5% 2412 1183 1239 2408 2393 3382 2392 362 1888 2392 2396 4878 - dovecot 1.1.1 compiled with --with-ldap, RHEL4. Same conf file with mail_nfs_storage = yes added. Command run: Totals: Logi List Stat Sele Fetc Fet2 Sort Stor Dele Expu Appe Logo 100% 50% 50% 100% 100% 100% 100% 50% 100% 100% 100% 100% 30% 5% 2684 1387 1331 2663 2636 3764 2636 397 2079 2636 2655 5386 So it's something like a 10-15% improvement. Tomorrow i'll repeat this tests and record cpu load. Is there anything else I should try? # /usr/local/sbin/dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf syslog_facility: local1 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /usr/share/ssl/certs/dovecot-beta.pem ssl_key_file: /usr/share/ssl/certs/dovecot-beta.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir:INDEX=/var/dovecot/%u:CONTROL=/var/dovecot-nas/%u/control mmap_disable: yes mail_nfs_storage: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: master_user_separator: * passdb: driver: pam passdb: driver: passwd-file args: /usr/local/etc/dovecot-master.conf master: yes userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs -- Joseba Torre. CIDIR Bizkaia. signature.asc Description: This is a digitally signed message part.
Re: [Dovecot] OT - Legal disclaimers - WAS: Re: Poor pop3 over nfs performance
El Miércoles, 2 de Julio de 2008 a las 13:50, Charles Marcus escribió: On 7/2/2008, Mark Zealey ([EMAIL PROTECTED]) wrote: This mail is subject to http://www.gxn.net/disclaimer Wow... good idea for disclaimers (I hate them)... IANAL, but: It's not only that we all hate them; also they are questionable in a legal point of view. They are based on: - It is intended for the addressee(s) only. If you have received this communication in error please notify the sender Yeah; I got the message, so I'm the addresee. No point here. And my telephatic powers are down now, so I can't know if it's been an error or not. - delete this message from your system without copying or disseminating it or placing any reliance upon its contents Well, you sent it to me, so it's mine now. Sending a message to me doesn't give you the power to tell me what should I do; otherwise, I could say something like send me all the files in your hard disk so I can verify you save no copy of this messages or even send me 1000$. - Confidentially Under spanish law, I have to SIGN a contract BEFORE I access to the confidential content. No contract, no confidentially. They can not show me some content and, later, tell me it was confidential. Some interesting articles about this: - in spanish: http://www.iabogado.com/esp/blogcfm/1/2007/12/Los-avisos-de-confidencialidad-en-los-correos-esos-engendros-jurdicos.cfm - in english: http://www.goldmark.org/jeff/stupid-disclaimers/ And yes, I'm really tired of this messages... Aagur. -- Joseba Torre. CIDIR Bizkaia. signature.asc Description: This is a digitally signed message part.
Re: [Dovecot] OT - Legal disclaimers
On 7/2/2008, Joseba Torre ([EMAIL PROTECTED]) wrote: Wow... good idea for disclaimers (I hate them)... IANAL, but: It's not only that we all hate them; also they are questionable in a legal point of view. They are based on: I understand all of that. I did *not* ask for endless comments about how/why they are silly, useless, impossible to enforce or evil. I simply asked if anyone who lives in a country where these are now legally *mandated*, if this one-line url reference satisfies these legally required disclaimers. So please, if you cannot comment on this question, don't comment at all. -- Best regards, Charles
Re: [Dovecot] Errors running imaptest with dovecot-1.1.1
On Jul 2, 2008, at 2:58 PM, Joseba Torre wrote: - dovecot v1.0.13 compiled with --with-ldap, RHEL4. Command run $ imaptest user=imaptest%03d pass=paquitoelchocolatero mbox=dovecot.mbox clients=50 seed=321 sort=100 secs=100 2 /dev/null .. So it's something like a 10-15% improvement. Note that imaptest mainly tests CPU usage, not disk I/O because most of the files will stay in OS cache. The real world performance should be better than what imaptest shows. IMAP benchmarking is really hard to do well. :) mmap_disable: yes If indexes are local, there's no need to disable mmap. mail_nfs_storage: yes mail_nfs_storage=yes makes Dovecot slightly slower compared to v1.0 (but fixes problems with multiple NFS client machines). PGP.sig Description: This is a digitally signed message part
Re: [Dovecot] Dovecot Config Problem
On Jul 2, 2008, at 12:11 PM, Kaushal Gandhi wrote: Hello, I am getting below error dovecot is not working.. -- [EMAIL PROTECTED] # dovecot -n | head -1 Error: Error in configuration file /usr/local/etc/dovecot.conf line 1: Expecting '=' Fatal: Invalid configuration in /usr/local/etc/dovecot.conf What operating system? You could try if it works by deleting #define HAVE_PREAD_H line from config.h and recompiling. Other than that and Charles's suggestion I have no idea why it would say that. PGP.sig Description: This is a digitally signed message part
[Dovecot] LDAP Auth
Hello all. Im trying to configure Dovecot to auth at LDAP. Main idea what login = email of user. At dovecot-ldap: hosts = 127.0.0.1 dn = cn=root,dc=ForexClub dnpass = secret tls = no debug_level = 1 auth_bind = no ldap_version = 3 base = dc=Virtual-Domains,dc=ForexClub deref = never scope = subtree user_attrs = user_filter = ((objectClass=mailUser)(mail=%u)) pass_attrs = mail=user,userPassword=password pass_filter = ((objectClass=mailUser)(mail=%u)) default_pass_scheme = CRYPT And... all works fine. Im can connect and auth. But in logs with debug_level=1 im see this: As im think it is *not* good. As im understand he not found anythink. BUT it is auth and work... Whats wrong? dovecot: Jul 02 19:47:11 Info: auth(default): client in: AUTH 1 PLAIN service=imapsecured lip=172.16.1.19 rip=172.16.1.80 lport=143 rport=59553 dovecot: Jul 02 19:47:11 Info: auth(default): client out: CONT 1 dovecot: Jul 02 19:47:11 Info: auth(default): client in: CONThidden dovecot: Jul 02 19:47:11 Info: auth(default): ldap([EMAIL PROTECTED],172.16.1.80): pass search: base=dc=Virtual-Domains,dc=ForexClub scope=subtree filter=((objectClass=mailUser)([EMAIL PROTECTED])) fields=mail,userPassword dovecot: Jul 02 19:47:11 Error: auth(default): ldap_search dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: ((objectClass=mailUser)([EMAIL PROTECTED])) dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: AND dovecot: Jul 02 19:47:11 Error: auth(default): put_filter_list (objectClass=mailUser)([EMAIL PROTECTED]) dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: (objectClass=mailUser) dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: simple dovecot: Jul 02 19:47:11 Error: auth(default): put_simple_filter: objectClass=mailUser dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: ([EMAIL PROTECTED]) dovecot: Jul 02 19:47:11 Error: auth(default): put_filter: simple dovecot: Jul 02 19:47:11 Error: auth(default): put_simple_filter: [EMAIL PROTECTED] dovecot: Jul 02 19:47:11 Error: auth(default): ldap_send_initial_request dovecot: Jul 02 19:47:11 Error: auth(default): ldap_send_server_request dovecot: Jul 02 19:47:11 Error: auth(default): ldap_result ld 0x18529160 msgid -1 dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList returns ld 0x18529160 NULL dovecot: Jul 02 19:47:11 Error: auth(default): wait4msg ld 0x18529160 msgid -1 (timeout 0 usec) dovecot: Jul 02 19:47:11 Error: auth(default): wait4msg continue ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): ** ld 0x18529160 Connections: dovecot: Jul 02 19:47:11 Error: auth(default): * host: 127.0.0.1 port: 389 (default) dovecot: Jul 02 19:47:11 Error: auth(default): refcnt: 2 status: Connected dovecot: Jul 02 19:47:11 Error: auth(default): last used: Wed Jul 2 19:47:11 2008 dovecot: Jul 02 19:47:11 Error: auth(default): dovecot: Jul 02 19:47:11 Error: auth(default): ** ld 0x18529160 Outstanding Requests: dovecot: Jul 02 19:47:11 Error: auth(default): * msgid 6, origid 6, status InProgress dovecot: Jul 02 19:47:11 Error: auth(default):outstanding referrals 0, parent count 0 dovecot: Jul 02 19:47:11 Error: auth(default): ** ld 0x18529160 Response Queue: dovecot: Jul 02 19:47:11 Error: auth(default):Empty dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList returns ld 0x18529160 NULL dovecot: Jul 02 19:47:11 Error: auth(default): ldap_int_select dovecot: Jul 02 19:47:11 Error: auth(default): read1msg: ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): read1msg: ld 0x18529160 msgid 6 message type search-entry dovecot: Jul 02 19:47:11 Error: auth(default): ldap_result ld 0x18529160 msgid -1 dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): ldap_chkResponseList returns ld 0x18529160 NULL dovecot: Jul 02 19:47:11 Error: auth(default): wait4msg ld 0x18529160 msgid -1 (timeout 0 usec) dovecot: Jul 02 19:47:11 Error: auth(default): wait4msg continue ld 0x18529160 msgid -1 all 1 dovecot: Jul 02 19:47:11 Error: auth(default): ** ld 0x18529160 Connections: dovecot: Jul 02 19:47:11 Error: auth(default): * host: 127.0.0.1 port: 389 (default) dovecot: Jul 02 19:47:11 Error: auth(default): refcnt: 2 status: Connected dovecot: Jul 02 19:47:11 Error: auth(default): last used: Wed Jul 2 19:47:11 2008 dovecot: Jul 02 19:47:11 Error: auth(default): dovecot: Jul 02 19:47:11 Error: auth(default): ** ld 0x18529160 Outstanding Requests: dovecot: Jul 02 19:47:11 Error: auth(default): * msgid 6, origid 6, status InProgress dovecot: Jul 02 19:47:11 Error: auth(default):outstanding referrals 0, parent count 0 dovecot: Jul 02
Re: [Dovecot] OT - Legal disclaimers
--On Wednesday, July 02, 2008 2:25 PM +0200 Joseba Torre [EMAIL PROTECTED] wrote: - in english: http://www.goldmark.org/jeff/stupid-disclaimers/ That's a good one. Be sure to follow the link to his funny examples. http://www.goldmark.org/jeff/stupid-disclaimers/fun.html Some other discussion of silly ones here (look for sillier disclaimers). http://lists.roaringpenguin.com/pipermail/mimedefang/2005-December/thread.html
Re: [Dovecot] 1.1 namespaces and message corruption
On Tuesday, July 1 at 11:15 PM, quoth Timo Sirainen: zlib plugin is somehow broken. If it's loaded then non-hardlink copying from a maildir results in zero byte output. I'll look at it later - it's not obvious why it's broken. Aha! Excellent catch - thanks Timo! ~Kyle -- Truth springs from argument amongst friends. -- David Hume pgpq9Kpcn0wSD.pgp Description: PGP signature
[Dovecot] v1.1.1 bug BUG: Authentication client said it's PID 0
Found this in my logs today: Jul 2 21:51:29 postamt dovecot: auth(default): BUG: Authentication client said it's PID 0 Jul 2 21:51:29 postamt dovecot: child 16847 (login) killed with signal 11 -- Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED] Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de The big picture is that anyone who sticks their mailbox server on internet as their MX instead of using a dedicated SMTP anti-abuse gateway as MX is bending over and begging for it.
[Dovecot] POP3 Mails Not Deleted
Dear all, Hi. This is imacat from Taiwan. We are running Dovecot 1.1.1. I received complaints from one of my colleagues. She checks her mails both from home and from office, so she left her mails in the server for 3 days. This morning she got lots of received mails again. I tracked the syslog, and found the following records: Jul 2 18:39:59 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=0/0, del=0/577, size=55354063 Jul 3 11:59:17 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=99/4866408, del=287/676, size=60218727 Jul 3 12:05:19 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=288/35132998, del=2/677, size=60220846 Jul 3 12:09:58 odin dovecot: POP3(mindyw): Disconnected: Logged out top=0/0, retr=2/9289, del=2/675, size=60190368 It seems that the deleted 287 mails was not really deleted, though the second deletion works. This happens occationally, so I cannot easily reproduce it. Can anyone look into this issue? How can I debug further? Thank you very much in advance. -- imacat ^_*' [EMAIL PROTECTED] PGP Key: http://www.imacat.idv.tw/me/pgpkey.asc Tavern IMACAT's http://www.imacat.idv.tw/ Woman's Voice http://www.wov.idv.tw/ TLUG List Manager http://www.linux.org.tw/mailman/listinfo/tlug pgpkScALKJwz0.pgp Description: PGP signature
