Re: [Dovecot] How to troubleshoot LDA or LMTP?

2013-08-08 Thread John Williams
Steffen Kaiser skdove...@smail.inf.fh-brs.de writes:

 On Tue, 6 Aug 2013, John Williams wrote:

 dovecot-lda -c config-file -d user  mailfile
 Aha!  Piping a message to the process was the step I was not aware of.

 does offlineimap provides logs to get to know what mails are newly 
 arriving to your local mail storage,
Yes.

 in order to not filter the same message twice or re-filter messages,
 you've moved around manually?
That is not a problem.  The filtering process works perfectly when I
manually invoke dovecot-lda.  My problem is that I have followed the
instructions here:

http://wiki2.dovecot.org/LDA/

and here:

http://wiki2.dovecot.org/LDA/Sendmail

and here:

http://wiki2.dovecot.org/LMTP

but neither dovecot-lda nor LMTP seem to be triggered whenever I send
email from my MUA (Gnus).  At least, I *think* I have followed the
instructions correctly.  Would you like me to post my dovecot config
again, and the relevant portion of sendmail.cf?

Thank you very much for your help, I truly appreciate it.



Re: [Dovecot] Override master service settigs with spaces

2013-08-08 Thread Ulrich Zehl
On Wed, Aug 07, 2013 at 10:49:28PM +0200, Axel Luttgens wrote:
 
 What makes you think quota-status would accept a -o option?

Every service running under master accepts -o, as far as I can tell from
the code. (Additionally verified by my tests; for settings without spaces
it works well.)

 And what's that quota_status_success plugin supposed to do?

It's just a setting that you'd normally set in conf.d/90-quota.conf (or
similar) like this:

plugin {
  quota_status_success = DUNNO
}

It tells quota-status what action to return to Postfix when the message
will fit into quota, just like quota_status_overquota (and
quota_status_toolarge since 2.2.5) do for messages that will not fit.


Re: [Dovecot] The docs a re a bit weird on Directory hashing

2013-08-08 Thread Jan-Frode Myklebust
On Thu, Aug 08, 2013 at 01:42:43AM +0300, Eliezer Croitoru wrote:
 
 And means a two layers cache of max 16 directories on the first layer
 and 256 directories on the second layer.
 The above allows millions of files storage and can benefit from all ext4
 lower kernel levels of compatibly rather then do stuff on the user-land..
 Since I am not 100% sure that the scheme I understood is indeed what I
 think I assume the above will need a small correction.

I use:

mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln

which gives me 256 buckets containing domainname/username/, and the
buckets are a hash of Lowercase Reverse usernames. To get the same
layout as squid, I would try:

mail_home = /srv/mailstore/%16LRHu/%256LRHu/%Lu

Ref: http://wiki2.dovecot.org/Variables for variables and modifiers.

BTW: I'm lowercasing everything, because I once got bitten by a variable
not being lowercased in one version, and suddenly this changing in
another version. It's probably redundant here -- but it was painful to
fix when it happened..


  -jf


Re: [Dovecot] Override master service settigs with spaces

2013-08-08 Thread Timo Sirainen
On 7.8.2013, at 19.03, Ulrich Zehl ulrich-dove...@topfen.net wrote:

 I'd like to override one setting for a master service in
 conf.d/10-master.conf. Unfortunately, said setting contains spaces, and I
 do not know how to escape them properly.

There is no support for escaping currently.

  executable = quota-status -p postfix -o plugin/quota_status_success=Testing 
 1 2 3

Maybe this should work.. But for now you can just write a wrapper script.



Re: [Dovecot] Expunged message reappeared, giving a new UID

2013-08-08 Thread Simon Fraser
On Tue, 2013-08-06 at 19:15 +0300, Timo Sirainen wrote:

  Presumably it's thinking the -r /tmp/dsync-rawlog is a mail location?
  I've tried changing its location in the appends, but it doesn't make a
  difference. 
 
 Oops, I messed up the parameter order. It was supposed to have -s state but 
 now it had -s -r rawlog state. New patch should work better.

I ran two tests: one using 'doveadm expunge' and one deleting the
message using mutt. Since the hosts mentioned so far have a copy of my
full mailbox on, I re-ran the tests (with the same results) on a test
server with a fresh mailbox on, so there was no extra folder
synchronisation in there to fill up the rawlog. 

Those log entries are too big for the mailing list (70k+), so are here:

'doveadm expunge' dsync-rawlog node A
http://pastebin.com/LtUnENPv

'doveadm expunge' dsync-rawlog node B
http://pastebin.com/QaWLyZq2

imap expunge dsync-rawlog node A
http://pastebin.com/SuFdWn0w

imap expunge dsync-rawlog node B
http://pastebin.com/Ex66s7hq

Mail logs on both contain entries like this:
Aug  6 18:04:37 dcot2a dovecot: master: Dovecot v2.2.5 starting up (core
dumps disabled)
Aug  6 18:04:38 dcot2a dovecot: doveadm: Error: Don't give mail location
with -d parameter

Simon.



-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE. 


Re: [Dovecot] The docs a re a bit weird on Directory hashing

2013-08-08 Thread Timo Sirainen
BTW. If you're using v2.2.3+ %N hash works better than the old %H hash. I 
updated http://wiki2.dovecot.org/Variables for it also.

On 8.8.2013, at 1.42, Eliezer Croitoru elie...@ngtech.co.il wrote:

 In squid we use a double layer of hashed directories on the FS to allow
 storage of millions of files.
 I was reading the Directory hashing section but never understood it..
 since it's written.. in a way I could not understand.
 I am using this line:
 mail_location = maildir:/home/vmail/%d/%n/Maildir/
 
 and I want to migrate to a hash based directory scheme.
 While trying to understand how that hash will work I stumbled a old
 thread at:
 http://www.dovecot.org/list/dovecot/2010-June/049695.html
 there they used:
 mail_location=maildir:/buzones/us.es/%1Hu/%2.1u/%n
 
 so I assume it should be used like that:
 mail_location=maildir:/home/vmail/%H/%2.256Hn/%d_%n/Maildir/
 or:
 mail_location=maildir:/home/vmail/%1Mu/%2.1Mu/%d_%n/Maildir/
 
 It's a bit hard to think alone so I hope you can assist me.
 
 let say I want to follow the model of squid cache_dir which has:
 cache_dir aufs /usr/local/squid/var/cache/squid 4 16 256
 
 And means a two layers cache of max 16 directories on the first layer
 and 256 directories on the second layer.
 The above allows millions of files storage and can benefit from all ext4
 lower kernel levels of compatibly rather then do stuff on the user-land..
 Since I am not 100% sure that the scheme I understood is indeed what I
 think I assume the above will need a small correction.
 
 Eliezer
 



Re: [Dovecot] Override master service settigs with spaces

2013-08-08 Thread Axel Luttgens
Le 8 août 2013 à 09:10, Ulrich Zehl a écrit :

 On Wed, Aug 07, 2013 at 10:49:28PM +0200, Axel Luttgens wrote:
 
 What makes you think quota-status would accept a -o option?
 
 Every service running under master accepts -o, as far as I can tell from
 the code. (Additionally verified by my tests; for settings without spaces
 it works well.)

Hello Ulrich,

Sorry for the noise.
I guess I was terribly tired yesterday, since I just didn't manage to 
understand what you were trying...

Axel



[Dovecot] HG changes affecting received headers

2013-08-08 Thread Thomas Leuxner
Let me say this is a rather cosmetic issue, but it appears with the latest 
commits (around 2.2.5 release) the scheme of 'Received' headers has changed for 
LMTP:

1) Inet socket:
Return-Path: dfn-adv-boun...@dfn-cert.de
Delivered-To: t...@leuxner.net
Received: from spectre.leuxner.net ([188.138.0.199])
by spectre.leuxner.net (Dovecot) with LMTP id 8AkXDF5cA1LvDgAAZ53dLw
for t...@leuxner.net; Thu, 08 Aug 2013 10:52:46 +0200

2) UNIX socket:
Return-Path: dfn-adv-boun...@dfn-cert.de
Delivered-To: t...@leuxner.net
Received: from spectre.leuxner.net ([])
by spectre.leuxner.net (Dovecot) with LMTP id q8WuGflcA1I3DwAAZ53dLw
for t...@leuxner.net; Thu, 08 Aug 2013 10:55:21 +0200

3) Old (Pre 2.2.5) build, UNIX socket:
Return-Path: dfn-adv-boun...@dfn-cert.de
Delivered-To: t...@leuxner.net
Received: from spectre.leuxner.net
by spectre.leuxner.net (Dovecot) with LMTP id 8NiKKX0h+lFRIAAAZ53dLw
for t...@leuxner.net; Thu, 01 Aug 2013 10:51:09 +0200

While it probably should resolve the FQDN in 1) (Postfix does), not sure what 
it should do with a UNIX socket in 2). Previously as shown in 3) it had none of 
it...

Thomas


signature.asc
Description: Digital signature


Re: [Dovecot] How to troubleshoot LDA or LMTP?

2013-08-08 Thread Steffen Kaiser

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Thu, 8 Aug 2013, John Williams wrote:


in order to not filter the same message twice or re-filter messages,
you've moved around manually?

That is not a problem.  The filtering process works perfectly when I
manually invoke dovecot-lda.  My problem is that I have followed the
instructions here:

http://wiki2.dovecot.org/LDA/

and here:

http://wiki2.dovecot.org/LDA/Sendmail

and here:

http://wiki2.dovecot.org/LMTP

but neither dovecot-lda nor LMTP seem to be triggered whenever I send
email from my MUA (Gnus).  At least, I *think* I have followed the
instructions correctly.  Would you like me to post my dovecot config
again, and the relevant portion of sendmail.cf?

Thank you very much for your help, I truly appreciate it.


As Stan already pointed out: a local delivery takes place only, when the 
mail arrives via a MTA. offlineimap synchronizes two IMAP folders, there 
is no local delivery at your side at all. Hence, neither LDA nor LMTP is 
invoked.


So I see two ways:

1) keep offlineimap to resync your local store back to the server and keep 
both in-sync.


Then you can:
1a) run offlineimap to get new messages from the upstream server and sync 
current local messages.
1b) remove the new ones from the local store and feed them _manually_ to 
the LDA or LMTP. Now the filtering takes place and they are re-added to 
the mail storage.
1c) maybe: re-run the process until no new messages got downloaded, in 
order to keep the server in-sync


2) no need for server messages in-sync with local message store

2a) setup a local MTA that accepts your domain and drops messages via 
Dovecot LDA or LMTP. Then get the new messages via fetchmail on a regular 
basis and hand the messages over to the local MTA.


2b) use fetchmail in combination with Dovecot LDA/LMTP. No local MTA 
necessary.


fetchmail will see only messages in INBOX as far as I know. So no 
filtering on the server must take place.


- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBUgNiqV3r2wJMiz2NAQISSAgAnSWnyf4kzNrbEd/+UcZGvmeegCWp4QY3
TWAIh8V8vbo+FyKyYomvRLt1mmq5CKJNwOUdz+A3u5R6XT25JZKxA5yYhUKlLNEU
n05zIsmWvKV6DWahdTv7GL84kmyETqp7zYo5pBWRf9SqwGFH8+KcBGh1U3MTaKhQ
QfzIj3eYk7a1DQld7u3ZaLSiKCBadWCakgNscY2mX+gzoN4EXt+X1zMO52uaZpJ3
QkJyd2AHrnpYgBbmr2maneYox3+67IyQChnzZ0t2c9uPodT4ukEkZFYjrucEGlfv
JEUaOaVnuzx/Wi7gxSUL/agSiaksLaEkT/KMWS6wQMSI0NxUaGIHjQ==
=f/Uy
-END PGP SIGNATURE-


[Dovecot] Errors in SASL authentication (attempted master login)

2013-08-08 Thread Grzegorz Staniak
Hi,

I'm using dovecot 2.2.4 (with Postfix 2.8.4) as both the SASL
authentication backend and the delivery agent, and I keep getting
lines like the following in the dovecot.log from the authentication
subsystem:

auth: passdb(toshiba1@domain,8.8.8.8,master): Attempted master login
with no master passdbs (trying to log in as user: plain)

The connections come from an old (embedded) mail client in a
printer-fax machine. I googled for this specific error, but I only
found info about old clients using user\0user\0pass string
incorrectly during authentication, which caused a problem for earlier,
development versions of dovecot. Actually, I recently migrated from
1.2 to 2.2.4 exactly to alleviate this situation, but the errors
persist. Is there a way to remove the problem or work around it?

Regards,
GS
-- 
Grzegorz Staniak gstaniak [at] gmail _dot_ com


Re: [Dovecot] Please HELP: how to delete all messages older than X days

2013-08-08 Thread Răzvan Sandu

Pe 7 Aug 2013 11:35, Timo Sirainen a scris:


Thank you, but doveadm expunge will ask for the mailbox name:

[root@mail1 ~]# doveadm expunge -u john@example.com ON
2013-08-07 doveadm(root): Fatal: expunge: To avoid accidents,
search query must contain MAILBOX in all search branches


Add: mailbox '*'


Thank you, it works!

May I use the same wildcard syntax ('*') when configuring the expire
plugin?  Something like:

mail_plugins = $mail_plugins expire

plugin {
  expire = *
}

or

plugin {
  expire = '*'
}


?


Best regards,
Răzvan
attachment: razvan_sandu.vcf

[Dovecot] multiple passdbs and auth sockets

2013-08-08 Thread Marco d'Itri
I have a few systems which run dovecot 1.x as the authentication backend 
for Postfix, with multiple auth { } sections like this one, each one 
with a different passdb and its own socket:

auth ldap-10 {
  passdb ldap {
args = /etc/dovecot/dovecot-ldap-10.conf
   }
  socket listen {
client {
  path = /var/spool/postfix/private/auth-10
  mode = 0666
}
  }
}

I need multiple sockets tied to multiple dbs because there are duplicated 
accounts, but after switching to dovecot 2.1.7 apparently *all* passdbs 
are checked and dovecot reports this message:

Warning: Obsolete setting in /etc/dovecot/conf.d/auth-local.conf.ext:91: add 
auth_ prefix to all settings inside auth {} and remove the auth {} section 
completely

doveconf shows that all my custom sockets are now part of a single 
service auth { } section, while all the passdbs appear at the top 
level.

How can I update my configuration for dovecot 2.x?

-- 
ciao,
Marco


Re: [Dovecot] HG changes affecting received headers

2013-08-08 Thread Timo Sirainen
On 8.8.2013, at 12.07, Thomas Leuxner t...@leuxner.net wrote:

 Let me say this is a rather cosmetic issue, but it appears with the latest 
 commits (around 2.2.5 release) the scheme of 'Received' headers has changed 
 for LMTP:

Thanks. I thought I found all such occurrences, but looks like I missed that 
one for some reason. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/9aa9944bd96e

 1) Inet socket:
 Return-Path: dfn-adv-boun...@dfn-cert.de
 Delivered-To: t...@leuxner.net
 Received: from spectre.leuxner.net ([188.138.0.199])
   by spectre.leuxner.net (Dovecot) with LMTP id 8AkXDF5cA1LvDgAAZ53dLw
   for t...@leuxner.net; Thu, 08 Aug 2013 10:52:46 +0200
 
 2) UNIX socket:
 Return-Path: dfn-adv-boun...@dfn-cert.de
 Delivered-To: t...@leuxner.net
 Received: from spectre.leuxner.net ([])
   by spectre.leuxner.net (Dovecot) with LMTP id q8WuGflcA1I3DwAAZ53dLw
   for t...@leuxner.net; Thu, 08 Aug 2013 10:55:21 +0200
 
 3) Old (Pre 2.2.5) build, UNIX socket:
 Return-Path: dfn-adv-boun...@dfn-cert.de
 Delivered-To: t...@leuxner.net
 Received: from spectre.leuxner.net
   by spectre.leuxner.net (Dovecot) with LMTP id 8NiKKX0h+lFRIAAAZ53dLw
   for t...@leuxner.net; Thu, 01 Aug 2013 10:51:09 +0200
 
 While it probably should resolve the FQDN in 1) (Postfix does), not sure what 
 it should do with a UNIX socket in 2). Previously as shown in 3) it had none 
 of it...
 
 Thomas



Re: [Dovecot] The docs a re a bit weird on Directory hashing

2013-08-08 Thread Eliezer Croitoru
Hey,

On 08/08/2013 10:29 AM, Jan-Frode Myklebust wrote:
 On Thu, Aug 08, 2013 at 01:42:43AM +0300, Eliezer Croitoru wrote:

 And means a two layers cache of max 16 directories on the first layer
 and 256 directories on the second layer.
 The above allows millions of files storage and can benefit from all ext4
 lower kernel levels of compatibly rather then do stuff on the user-land..
 Since I am not 100% sure that the scheme I understood is indeed what I
 think I assume the above will need a small correction.
 
 I use:
 
   mail_home = /srv/mailstore/%256LRHu/%Ld/%Ln
R what for??
I do understand a Lower case on the names and have seen the effect but
how would R be helpful??

Eliezer
 
 which gives me 256 buckets containing domainname/username/, and the
 buckets are a hash of Lowercase Reverse usernames. To get the same
 layout as squid, I would try:
 
   mail_home = /srv/mailstore/%16LRHu/%256LRHu/%Lu
 
 Ref: http://wiki2.dovecot.org/Variables for variables and modifiers.
 
 BTW: I'm lowercasing everything, because I once got bitten by a variable
 not being lowercased in one version, and suddenly this changing in
 another version. It's probably redundant here -- but it was painful to
 fix when it happened..
 
 
   -jf
 



[Dovecot] GUID Mismatch Issue

2013-08-08 Thread Jeff Geiger
Dovecot 2.1.7

While migrating mail from one server (Maildir) to another (mdbox), a config
issue caused my dsync to fail on a few accounts.  Those accounts received
mail on the new server over night and it autocreated new inboxes with new
GUIDs.  Now dsync wants nothing to do with mirroring between the two (diff
GUIDs).  Is there a way to fix this?

dsync(j...@foo.bar): Error: Mailbox INBOX changed its GUID
(0eee4b021dcadd515855eed085a1 - 43f87412a8f00352ac34be821591)
dsync(j...@foo.bar): Error: msg iteration failed: Couldn't open mailbox
0eee4b021dcadd515855eed085a1
dsync(j...@foo.bar): Error: Mailbox INBOX changed its GUID
(0eee4b021dcadd515855eed085a1 - 43f87412a8f00352ac34be821591)
dsync(j...@foo.bar): Error: Mailbox Trash changed its GUID
(0fee4b021dcadd515855eed085a1 - 6300df050ef10352e935be821591)
dsync(j...@foo.bar): Error: Mailbox Sent changed its GUID
(832d1e3663cadd515f5deed085a1 - 855ef505c0f00352fc34be821591)

I need a way to merge the mailboxes, in either direction, so I can clear
out one side and successfully migrate the mail accounts.  Any tips or
pointers are greatly appreciated.


Re: [Dovecot] HG changes affecting received headers

2013-08-08 Thread Thomas Leuxner
* Timo Sirainen t...@iki.fi 2013.08.08 21:38:

 Thanks. I thought I found all such occurrences, but looks like I missed that 
 one for some reason. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/9aa9944bd96e

Thanks, confirmed fixed.


signature.asc
Description: Digital signature