Re: [Dovecot] How to troubleshoot LDA or LMTP?
Steffen Kaiser skdove...@smail.inf.fh-brs.de writes: On Tue, 6 Aug 2013, John Williams wrote: dovecot-lda -c config-file -d user mailfile Aha! Piping a message to the process was the step I was not aware of. does offlineimap provides logs to get to know what mails are newly arriving to your local mail storage, Yes. in order to not filter the same message twice or re-filter messages, you've moved around manually? That is not a problem. The filtering process works perfectly when I manually invoke dovecot-lda. My problem is that I have followed the instructions here: http://wiki2.dovecot.org/LDA/ and here: http://wiki2.dovecot.org/LDA/Sendmail and here: http://wiki2.dovecot.org/LMTP but neither dovecot-lda nor LMTP seem to be triggered whenever I send email from my MUA (Gnus). At least, I *think* I have followed the instructions correctly. Would you like me to post my dovecot config again, and the relevant portion of sendmail.cf? Thank you very much for your help, I truly appreciate it.
Re: [Dovecot] Override master service settigs with spaces
On Wed, Aug 07, 2013 at 10:49:28PM +0200, Axel Luttgens wrote: What makes you think quota-status would accept a -o option? Every service running under master accepts -o, as far as I can tell from the code. (Additionally verified by my tests; for settings without spaces it works well.) And what's that quota_status_success plugin supposed to do? It's just a setting that you'd normally set in conf.d/90-quota.conf (or similar) like this: plugin { quota_status_success = DUNNO } It tells quota-status what action to return to Postfix when the message will fit into quota, just like quota_status_overquota (and quota_status_toolarge since 2.2.5) do for messages that will not fit.
Re: [Dovecot] The docs a re a bit weird on Directory hashing
On Thu, Aug 08, 2013 at 01:42:43AM +0300, Eliezer Croitoru wrote: And means a two layers cache of max 16 directories on the first layer and 256 directories on the second layer. The above allows millions of files storage and can benefit from all ext4 lower kernel levels of compatibly rather then do stuff on the user-land.. Since I am not 100% sure that the scheme I understood is indeed what I think I assume the above will need a small correction. I use: mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln which gives me 256 buckets containing domainname/username/, and the buckets are a hash of Lowercase Reverse usernames. To get the same layout as squid, I would try: mail_home = /srv/mailstore/%16LRHu/%256LRHu/%Lu Ref: http://wiki2.dovecot.org/Variables for variables and modifiers. BTW: I'm lowercasing everything, because I once got bitten by a variable not being lowercased in one version, and suddenly this changing in another version. It's probably redundant here -- but it was painful to fix when it happened.. -jf
Re: [Dovecot] Override master service settigs with spaces
On 7.8.2013, at 19.03, Ulrich Zehl ulrich-dove...@topfen.net wrote: I'd like to override one setting for a master service in conf.d/10-master.conf. Unfortunately, said setting contains spaces, and I do not know how to escape them properly. There is no support for escaping currently. executable = quota-status -p postfix -o plugin/quota_status_success=Testing 1 2 3 Maybe this should work.. But for now you can just write a wrapper script.
Re: [Dovecot] Expunged message reappeared, giving a new UID
On Tue, 2013-08-06 at 19:15 +0300, Timo Sirainen wrote: Presumably it's thinking the -r /tmp/dsync-rawlog is a mail location? I've tried changing its location in the appends, but it doesn't make a difference. Oops, I messed up the parameter order. It was supposed to have -s state but now it had -s -r rawlog state. New patch should work better. I ran two tests: one using 'doveadm expunge' and one deleting the message using mutt. Since the hosts mentioned so far have a copy of my full mailbox on, I re-ran the tests (with the same results) on a test server with a fresh mailbox on, so there was no extra folder synchronisation in there to fill up the rawlog. Those log entries are too big for the mailing list (70k+), so are here: 'doveadm expunge' dsync-rawlog node A http://pastebin.com/LtUnENPv 'doveadm expunge' dsync-rawlog node B http://pastebin.com/QaWLyZq2 imap expunge dsync-rawlog node A http://pastebin.com/SuFdWn0w imap expunge dsync-rawlog node B http://pastebin.com/Ex66s7hq Mail logs on both contain entries like this: Aug 6 18:04:37 dcot2a dovecot: master: Dovecot v2.2.5 starting up (core dumps disabled) Aug 6 18:04:38 dcot2a dovecot: doveadm: Error: Don't give mail location with -d parameter Simon. -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Re: [Dovecot] The docs a re a bit weird on Directory hashing
BTW. If you're using v2.2.3+ %N hash works better than the old %H hash. I updated http://wiki2.dovecot.org/Variables for it also. On 8.8.2013, at 1.42, Eliezer Croitoru elie...@ngtech.co.il wrote: In squid we use a double layer of hashed directories on the FS to allow storage of millions of files. I was reading the Directory hashing section but never understood it.. since it's written.. in a way I could not understand. I am using this line: mail_location = maildir:/home/vmail/%d/%n/Maildir/ and I want to migrate to a hash based directory scheme. While trying to understand how that hash will work I stumbled a old thread at: http://www.dovecot.org/list/dovecot/2010-June/049695.html there they used: mail_location=maildir:/buzones/us.es/%1Hu/%2.1u/%n so I assume it should be used like that: mail_location=maildir:/home/vmail/%H/%2.256Hn/%d_%n/Maildir/ or: mail_location=maildir:/home/vmail/%1Mu/%2.1Mu/%d_%n/Maildir/ It's a bit hard to think alone so I hope you can assist me. let say I want to follow the model of squid cache_dir which has: cache_dir aufs /usr/local/squid/var/cache/squid 4 16 256 And means a two layers cache of max 16 directories on the first layer and 256 directories on the second layer. The above allows millions of files storage and can benefit from all ext4 lower kernel levels of compatibly rather then do stuff on the user-land.. Since I am not 100% sure that the scheme I understood is indeed what I think I assume the above will need a small correction. Eliezer
Re: [Dovecot] Override master service settigs with spaces
Le 8 août 2013 à 09:10, Ulrich Zehl a écrit : On Wed, Aug 07, 2013 at 10:49:28PM +0200, Axel Luttgens wrote: What makes you think quota-status would accept a -o option? Every service running under master accepts -o, as far as I can tell from the code. (Additionally verified by my tests; for settings without spaces it works well.) Hello Ulrich, Sorry for the noise. I guess I was terribly tired yesterday, since I just didn't manage to understand what you were trying... Axel
[Dovecot] HG changes affecting received headers
Let me say this is a rather cosmetic issue, but it appears with the latest commits (around 2.2.5 release) the scheme of 'Received' headers has changed for LMTP: 1) Inet socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net ([188.138.0.199]) by spectre.leuxner.net (Dovecot) with LMTP id 8AkXDF5cA1LvDgAAZ53dLw for t...@leuxner.net; Thu, 08 Aug 2013 10:52:46 +0200 2) UNIX socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net ([]) by spectre.leuxner.net (Dovecot) with LMTP id q8WuGflcA1I3DwAAZ53dLw for t...@leuxner.net; Thu, 08 Aug 2013 10:55:21 +0200 3) Old (Pre 2.2.5) build, UNIX socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net by spectre.leuxner.net (Dovecot) with LMTP id 8NiKKX0h+lFRIAAAZ53dLw for t...@leuxner.net; Thu, 01 Aug 2013 10:51:09 +0200 While it probably should resolve the FQDN in 1) (Postfix does), not sure what it should do with a UNIX socket in 2). Previously as shown in 3) it had none of it... Thomas signature.asc Description: Digital signature
Re: [Dovecot] How to troubleshoot LDA or LMTP?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Thu, 8 Aug 2013, John Williams wrote: in order to not filter the same message twice or re-filter messages, you've moved around manually? That is not a problem. The filtering process works perfectly when I manually invoke dovecot-lda. My problem is that I have followed the instructions here: http://wiki2.dovecot.org/LDA/ and here: http://wiki2.dovecot.org/LDA/Sendmail and here: http://wiki2.dovecot.org/LMTP but neither dovecot-lda nor LMTP seem to be triggered whenever I send email from my MUA (Gnus). At least, I *think* I have followed the instructions correctly. Would you like me to post my dovecot config again, and the relevant portion of sendmail.cf? Thank you very much for your help, I truly appreciate it. As Stan already pointed out: a local delivery takes place only, when the mail arrives via a MTA. offlineimap synchronizes two IMAP folders, there is no local delivery at your side at all. Hence, neither LDA nor LMTP is invoked. So I see two ways: 1) keep offlineimap to resync your local store back to the server and keep both in-sync. Then you can: 1a) run offlineimap to get new messages from the upstream server and sync current local messages. 1b) remove the new ones from the local store and feed them _manually_ to the LDA or LMTP. Now the filtering takes place and they are re-added to the mail storage. 1c) maybe: re-run the process until no new messages got downloaded, in order to keep the server in-sync 2) no need for server messages in-sync with local message store 2a) setup a local MTA that accepts your domain and drops messages via Dovecot LDA or LMTP. Then get the new messages via fetchmail on a regular basis and hand the messages over to the local MTA. 2b) use fetchmail in combination with Dovecot LDA/LMTP. No local MTA necessary. fetchmail will see only messages in INBOX as far as I know. So no filtering on the server must take place. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUgNiqV3r2wJMiz2NAQISSAgAnSWnyf4kzNrbEd/+UcZGvmeegCWp4QY3 TWAIh8V8vbo+FyKyYomvRLt1mmq5CKJNwOUdz+A3u5R6XT25JZKxA5yYhUKlLNEU n05zIsmWvKV6DWahdTv7GL84kmyETqp7zYo5pBWRf9SqwGFH8+KcBGh1U3MTaKhQ QfzIj3eYk7a1DQld7u3ZaLSiKCBadWCakgNscY2mX+gzoN4EXt+X1zMO52uaZpJ3 QkJyd2AHrnpYgBbmr2maneYox3+67IyQChnzZ0t2c9uPodT4ukEkZFYjrucEGlfv JEUaOaVnuzx/Wi7gxSUL/agSiaksLaEkT/KMWS6wQMSI0NxUaGIHjQ== =f/Uy -END PGP SIGNATURE-
[Dovecot] Errors in SASL authentication (attempted master login)
Hi, I'm using dovecot 2.2.4 (with Postfix 2.8.4) as both the SASL authentication backend and the delivery agent, and I keep getting lines like the following in the dovecot.log from the authentication subsystem: auth: passdb(toshiba1@domain,8.8.8.8,master): Attempted master login with no master passdbs (trying to log in as user: plain) The connections come from an old (embedded) mail client in a printer-fax machine. I googled for this specific error, but I only found info about old clients using user\0user\0pass string incorrectly during authentication, which caused a problem for earlier, development versions of dovecot. Actually, I recently migrated from 1.2 to 2.2.4 exactly to alleviate this situation, but the errors persist. Is there a way to remove the problem or work around it? Regards, GS -- Grzegorz Staniak gstaniak [at] gmail _dot_ com
Re: [Dovecot] Please HELP: how to delete all messages older than X days
Pe 7 Aug 2013 11:35, Timo Sirainen a scris: Thank you, but doveadm expunge will ask for the mailbox name: [root@mail1 ~]# doveadm expunge -u john@example.com ON 2013-08-07 doveadm(root): Fatal: expunge: To avoid accidents, search query must contain MAILBOX in all search branches Add: mailbox '*' Thank you, it works! May I use the same wildcard syntax ('*') when configuring the expire plugin? Something like: mail_plugins = $mail_plugins expire plugin { expire = * } or plugin { expire = '*' } ? Best regards, Răzvan attachment: razvan_sandu.vcf
[Dovecot] multiple passdbs and auth sockets
I have a few systems which run dovecot 1.x as the authentication backend for Postfix, with multiple auth { } sections like this one, each one with a different passdb and its own socket: auth ldap-10 { passdb ldap { args = /etc/dovecot/dovecot-ldap-10.conf } socket listen { client { path = /var/spool/postfix/private/auth-10 mode = 0666 } } } I need multiple sockets tied to multiple dbs because there are duplicated accounts, but after switching to dovecot 2.1.7 apparently *all* passdbs are checked and dovecot reports this message: Warning: Obsolete setting in /etc/dovecot/conf.d/auth-local.conf.ext:91: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf shows that all my custom sockets are now part of a single service auth { } section, while all the passdbs appear at the top level. How can I update my configuration for dovecot 2.x? -- ciao, Marco
Re: [Dovecot] HG changes affecting received headers
On 8.8.2013, at 12.07, Thomas Leuxner t...@leuxner.net wrote: Let me say this is a rather cosmetic issue, but it appears with the latest commits (around 2.2.5 release) the scheme of 'Received' headers has changed for LMTP: Thanks. I thought I found all such occurrences, but looks like I missed that one for some reason. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/9aa9944bd96e 1) Inet socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net ([188.138.0.199]) by spectre.leuxner.net (Dovecot) with LMTP id 8AkXDF5cA1LvDgAAZ53dLw for t...@leuxner.net; Thu, 08 Aug 2013 10:52:46 +0200 2) UNIX socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net ([]) by spectre.leuxner.net (Dovecot) with LMTP id q8WuGflcA1I3DwAAZ53dLw for t...@leuxner.net; Thu, 08 Aug 2013 10:55:21 +0200 3) Old (Pre 2.2.5) build, UNIX socket: Return-Path: dfn-adv-boun...@dfn-cert.de Delivered-To: t...@leuxner.net Received: from spectre.leuxner.net by spectre.leuxner.net (Dovecot) with LMTP id 8NiKKX0h+lFRIAAAZ53dLw for t...@leuxner.net; Thu, 01 Aug 2013 10:51:09 +0200 While it probably should resolve the FQDN in 1) (Postfix does), not sure what it should do with a UNIX socket in 2). Previously as shown in 3) it had none of it... Thomas
Re: [Dovecot] The docs a re a bit weird on Directory hashing
Hey, On 08/08/2013 10:29 AM, Jan-Frode Myklebust wrote: On Thu, Aug 08, 2013 at 01:42:43AM +0300, Eliezer Croitoru wrote: And means a two layers cache of max 16 directories on the first layer and 256 directories on the second layer. The above allows millions of files storage and can benefit from all ext4 lower kernel levels of compatibly rather then do stuff on the user-land.. Since I am not 100% sure that the scheme I understood is indeed what I think I assume the above will need a small correction. I use: mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln R what for?? I do understand a Lower case on the names and have seen the effect but how would R be helpful?? Eliezer which gives me 256 buckets containing domainname/username/, and the buckets are a hash of Lowercase Reverse usernames. To get the same layout as squid, I would try: mail_home = /srv/mailstore/%16LRHu/%256LRHu/%Lu Ref: http://wiki2.dovecot.org/Variables for variables and modifiers. BTW: I'm lowercasing everything, because I once got bitten by a variable not being lowercased in one version, and suddenly this changing in another version. It's probably redundant here -- but it was painful to fix when it happened.. -jf
[Dovecot] GUID Mismatch Issue
Dovecot 2.1.7 While migrating mail from one server (Maildir) to another (mdbox), a config issue caused my dsync to fail on a few accounts. Those accounts received mail on the new server over night and it autocreated new inboxes with new GUIDs. Now dsync wants nothing to do with mirroring between the two (diff GUIDs). Is there a way to fix this? dsync(j...@foo.bar): Error: Mailbox INBOX changed its GUID (0eee4b021dcadd515855eed085a1 - 43f87412a8f00352ac34be821591) dsync(j...@foo.bar): Error: msg iteration failed: Couldn't open mailbox 0eee4b021dcadd515855eed085a1 dsync(j...@foo.bar): Error: Mailbox INBOX changed its GUID (0eee4b021dcadd515855eed085a1 - 43f87412a8f00352ac34be821591) dsync(j...@foo.bar): Error: Mailbox Trash changed its GUID (0fee4b021dcadd515855eed085a1 - 6300df050ef10352e935be821591) dsync(j...@foo.bar): Error: Mailbox Sent changed its GUID (832d1e3663cadd515f5deed085a1 - 855ef505c0f00352fc34be821591) I need a way to merge the mailboxes, in either direction, so I can clear out one side and successfully migrate the mail accounts. Any tips or pointers are greatly appreciated.
Re: [Dovecot] HG changes affecting received headers
* Timo Sirainen t...@iki.fi 2013.08.08 21:38: Thanks. I thought I found all such occurrences, but looks like I missed that one for some reason. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/9aa9944bd96e Thanks, confirmed fixed. signature.asc Description: Digital signature