Re: [Dovecot] dovecot 2.2.9 replication
I didn't get it.
What's wrong ?
What's not working?
-Original Message-
From: dovecot [mailto:dovecot-boun...@dovecot.org] On Behalf Of Франчук Олег
Sent: Wednesday, March 12, 2014 10:37 PM
To: dovecot@dovecot.org
Subject: [Dovecot] dovecot 2.2.9 replication
Good afternoon, I have a problem with replication is configured in
Dovecot, I have two servers, they are version 2.2.9. Here is their
configuration
/root@mx1:/etc/dovecot# dovecot -n//
//# 2.2.9: /etc/dovecot/dovecot.conf//
//# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4//
//auth_debug = yes//
//auth_debug_passwords = yes//
//auth_mechanisms = plain login//
//auth_socket_path = /var/run/dovecot/auth-master//
//base_dir = /var/run/dovecot///
//disable_plaintext_auth = no//
//dsync_remote_cmd = /usr/bin/ssh -l Debian-exim %{host}
/usr/bin/doveadm dsync-server -u//%u//-l%{lock_timeout} -n%{namespace}//
//first_valid_gid = 103//
//first_valid_uid = 101//
//listen = *//
//mail_access_groups = mail,Debian-exim,dovecot//
//mail_debug = yes//
//mail_full_filesystem_access = yes//
//mail_gid = 103//
//mail_location = maildir:/var/vmail/%d/%n//
//mail_plugins = notify replication//
//mail_uid = 101//
//managesieve_notify_capability = mailto//
//managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date//
//namespace inbox {//
// inbox = yes//
// location
=
//
// prefix
=
//
//}
//
//passdb
{
//
// args =
/etc/dovecot/dovecot-ldap.conf
//
// driver =
ldap
//
//}
//
//plugin {//
// autocreate = Trash//
// autocreate2 = Sent//
// autocreate3 = Drafts//
// autocreate4 = Junk//
// autosubscribe = Trash//
// autosubscribe2 = Sent//
// autosubscribe3 = Drafts//
// autosubscribe4 = Junk//
// mail_replica = remote:Debian-exim at 10.0.1.2//
// sieve = /var/vmail/%d/%n/currently-active-script.sieve//
// sieve_dir = /var/vmail/%d/%n/sieve//
//}//
//protocols = imap sieve pop3//
//service aggregator {//
// fifo_listener replication-notify-fifo {//
//mode = 0777//
//user = Debian-exim//
// }//
// unix_listener replication-notify {//
//mode = 0777//
//user = Debian-exim//
// }//
//}//
//service auth {//
// unix_listener auth-client {//
//group = Debian-exim//
//mode = 0666//
//user = Debian-exim//
// }//
// unix_listener auth-master {//
//group = Debian-exim//
//mode = 0666//
//user = Debian-exim//
// }//
// user = root//
//}//
//service config {//
// unix_listener config {//
//mode = 0777//
//user = Debian-exim//
// }//
//}//
//service doveadm {//
// user = Debian-exim//
//}//
//service imap-login {//
// inet_listener imap {//
//address = 127.0.0.1,209.51.169.117,10.0.1.1//
//port = 143//
// }//
//}//
//service managesieve-login {//
// executable = /usr/lib/dovecot/managesieve-login//
// inet_listener sieve {//
//address = 127.0.0.1,209.51.169.117,10.0.1.1//
//port = 2000//
// }//
// process_min_avail = 1//
// service_count = 1//
// vsz_limit = 64 M//
//}//
//service managesieve {//
// executable = /usr/lib/dovecot/managesieve//
// process_limit = 10//
//}//
//service pop3-login {//
// inet_listener pop3 {//
//address = 127.0.0.1,209.51.169.117,10.0.1.1//
//port = 110//
// }//
//}//
//service replicator {//
// process_min_avail = 1//
// unix_listener replicator-doveadm {//
//mode = 0777//
//user = Debian-exim//
// }//
// unix_listener replicator {//
//mode = 0777//
//user = Debian-exim//
// }//
//}//
//ssl = no//
//userdb {//
// args = /etc/dovecot/dovecot-ldap.conf//
// driver = ldap//
//}//
//protocol lda {//
// auth_socket_path =
Re: [Dovecot] delete message with specified id
that's it! thanks a lot! -- С уважением, Костырев Александр администратор Linux-систем -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Steffen Kaiser Sent: Friday, December 06, 2013 6:41 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] delete message with specified id -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 6 Dec 2013, Костырев Александр Алексеевич wrote: Could someone help me to find a way to delete message with certain id from all users's mailboxes? I think, this should do it [test, before killing your users messages ;-) ]: doveadm [-Dv] expunge [-S socket_path] [-d] -u user HEADER Message-ID 'msgid' http://wiki2.dovecot.org/Tools/Doveadm/Expunge doveadm-expunge - Expunge messages matching given search query To see the messages and performance: http://wiki2.dovecot.org/Tools/Doveadm/Search doveadm-search - Show a list of mailbox GUIDs and message UIDs matching given search query. same command line, but search instead of expunge - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUqF/mF3r2wJMiz2NAQJLKAgAjha9mfT+MWHnzIZ6PiJSwMqeSoe8DNZb FhXxt7gEqe1eEojBFOUkM17FdqwIjZ4PXHRook3vxSfBx0TtQ8xEkNMkyUKsjmLS Q51GjbwmOX964Xo4zSmo5R9b1bpyBW3jDfbYYMXXf1gLEFu82CPlIq+TL1IQAyrY YKr7ZXYM3Wy1sGpf6csF9WhMWUmj4XmQkgeoSTvlNQ0FL1EL7S4dhyrJCi5s1hcp XA6jHD2BchRdFxK02ikkYtPgDMDDduSl9wzxAJl5Ed4FG74nvf622DOYmPh+VbUt sYxLTfEVhFvNqkyuQhzarHlnzeFG4//R4+g0190j66C7O8QDGQWYcA== =gxly -END PGP SIGNATURE-
[Dovecot] delete message with specified id
Good day, everyone! Could someone help me to find a way to delete message with certain id from all users's mailboxes? What seems to be a problem: I have configured exim + dovecot lmtp I got a long list of aliases in BD in form of: +--+-+ |alias_name recipients | (for example) ---|-+ | list_a | us...@example.org,us...@example.org | +--|-+ When I send a message to that list_a, user1 and user2 get the mail and I see this in log: Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, us...@example.org): copy from INBOX: box=INBOX, uid=1, msgid=E1VojxY-0004Gl-Gu@beta-mail, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, us...@example.org): oCOXKmAkoVIjQAAA635u4w: msgid=E1VojxY-0004Gl-Gu@beta-mail: from=root@beta-mail: subj=: saved mail to INBOX Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, us...@example.org): copy from INBOX: box=INBOX, uid=1, msgid=E1VojxY-0004Gl-Gu@beta-mail, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, us...@example.org): oCOXKmAkoVIjQAAA635u4w: msgid=E1VojxY-0004Gl-Gu@beta-mail: from=root@beta-mail: subj=: saved mail to INBOX Is it possible to delete these letters with known msgid=E1VojxY-0004Gl-Gu@beta-mail from all users mailboxes with couple of simple commands ? How do I do it currently: in exim's log I get mailaddress of a user, get into his mailbox (wich cd), find the letter I need, with ls -i I get inode, search (with find) through all users mails and delete all files with that inode, then I have to rebuild dovecot indexes with doveadm mailbox status -A -t all INBOX -- С уважением, Костырев Александр администратор Linux-систем
[Dovecot] dovecot perl sasl ejabberd
Good day to all! We would like to authenticate our ejabberd against Dovecot with perl there's such a script http://www.ejabberd.im/files/contributions/check_dovecot.pl.txt that script uses following perl library - http://cpansearch.perl.org/src/SASHA/Authen-SASL-Authd-0.04/lib/Authen/SASL/Authd.pm Authentication is OK, but sub user_dovecot wich queues information about a specific user doesn't work with error dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: USER?1?use...@atlas-2.ru could someone help with this ? thanks in advance! -- С уважением, Костырев Александр администратор Linux-систем skype: a.kostyrev
[Dovecot] sieve redirect envelope address problem
Good day! I have a problem with mail redirection through sieve rules. I've configured sieve rule that redirects any mail coming to user to gmail mailbox (or whatever external mail system there is). But when sieve redirects any mail it puts vmail@%dovecot_hostname% into envelope address, gives it to my exim for delivery and gmail rejects my mail because user vmail@%dovecot_hostname% do not exist. Please, advice for what can be done about this behavior. my `doveconf -n` http://pastebin.com/0dyL9Jgs Thanks in advance! -- С уважением, Костырев Александр администратор Linux-систем
Re: [Dovecot] sieve redirect envelope address problem
Because it should be optional for users (to use or not to use filters). -- С уважением, Костырев Александр администратор Linux-систем -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Reindl Harald Sent: Wednesday, May 08, 2013 12:30 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] sieve redirect envelope address problem Am 08.05.2013 03:24, schrieb Костырев Александр Алексеевич: Good day! I have a problem with mail redirection through sieve rules. I've configured sieve rule that redirects any mail coming to user to gmail mailbox (or whatever external mail system there is). But when sieve redirects any mail it puts vmail@%dovecot_hostname% into envelope address, gives it to my exim for delivery and gmail rejects my mail because user vmail@%dovecot_hostname% do not exist. Please, advice for what can be done about this behavior if you say any mail coming to user why do you implent the forwarding in dovecot/sieve instead directly on the MTA? i am using postfix, so no idea how to implement it in exim but i have on asverer 9000 forwarders which never touch the LDA at all and directly forwarded from the MTA
Re: [Dovecot] sieve redirect envelope address problem [solved]
submission_host directive solved problem for me. Thanks! -- С уважением, Костырев Александр администратор Linux-систем -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Ben Morrow Sent: Wednesday, May 08, 2013 1:58 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] sieve redirect envelope address problem At 12PM +1100 on 8/05/13 you (Костырев Александр Алексеевич) wrote: I have a problem with mail redirection through sieve rules. I've configured sieve rule that redirects any mail coming to user to gmail mailbox (or whatever external mail system there is). But when sieve redirects any mail it puts vmail@%dovecot_hostname% into envelope address, gives it to my exim for delivery and gmail rejects my mail because user vmail@%dovecot_hostname% do not exist. Please, advice for what can be done about this behavior. Sieve should be submitting the mail to the outbound SMTP with the same envelope address as it had coming in (that is, this is a true SMTP redirect, not an SPF-compatible resending-from-a-new-address). I think your SMTP server must be rewriting this based on the uid of the LDA process; this is not something Dovecot can do anything about. To test this you can run sendmail(8) with the -f switch as the vmail user: if the address you specify is rewritten, then the problem is not with Dovecot. You need to fix this in your SMTP configuration, somehow. Decide what your policy is about the envelope sender of outbound mail: are you going to rewrite to @your.domain, which is SPF-compatible but messes up bounces; or are you going to leave it alone, which is what a sieve redirect is supposed to do but which can cause problems if the original sender publishes an SPF policy and the final recipient checks it (neither of which you can control)? There are a number of other variously-unpleasant alternatives, like SRS (which attempts to preserve the original sender while still only sending mail from @your.domain), but basically none of this is specific to sieve or Dovecot. Find out what happens if mail is forwarded in the ordinary way by your MTA, and then work out how to get the MTA to do that for any mail submitted by the 'vmail' user. Ben
[Dovecot] replication chain
good day! I wonder if it is possible to make a chain of replication in dovecot 2.1.9. Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but is it possible to setup replication like this: serverA --- serverB -- server C --- I've added additional mail_replica2 on serverB and after restart dovecot didn't complain about errors, with doveconf -n I am able to see two replica's settings but user's mails aren't replicating to server C. no errors in logs. I want to use server C as backup server with lvm snapshots.
Re: [Dovecot] Dsync replication
use the search, Luke) http://www.dovecot.org/list/dovecot/2012-March/064512.html this thread was all that I needed to setup replication for testing. -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of l...@airstreamcomm.net Sent: Friday, July 06, 2012 3:28 AM To: dovecot@dovecot.org Subject: [Dovecot] Dsync replication I have been loosely following discussions dsync replication, but I am wondering if this tool still in a testing phase or has it been committed as a production part of Dovecot? I would like to do some testing with the protocol to see if it's capable of handling the change rate our mail service generates, which has about 23,000 active users. We are trying to find solutions for a two site setup where mail processing is either being done at the primary data center A and fails over to a hot standby cluster at the secondary data center B, or where both data centers are doing active processing. I have been unable to find documentation on dsync replication on the wiki, so if there is any documentation available on how to setup dsync replication I would appreciate a nudge in the right direction.
Re: [Dovecot] RAID1+md concat+XFS as mailstorage
So, you say that one should use this configuration in production with hope that such failure would never happen? -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Stan Hoeppner Sent: Saturday, June 30, 2012 4:24 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] RAID1+md concat+XFS as mailstorage On 6/28/2012 7:15 AM, Ed W wrote: On 28/06/2012 13:01, Костырев Александр Алексеевич wrote: somewhere in maillist I've seen RAID1+md concat+XFS being promoted as mailstorage. Does anybody in here actually use this setup? I've decided to give it a try, but ended up with not being able to recover any data off survived pairs from linear array when _the_first of raid1 pairs got down. The failure of the RAID1 pair was due to an intentional breakage test. Your testing methodology was severely flawed. The result is the correct expected behavior of your test methodology. Proper testing will yield a different result. One should not be surprised that something breaks when he intentionally attempts to break it. This is the configuration endorsed by Stan Hoeppner. Yes. It works very well for metadata heavy workloads, i.e. maildir. -- Stan
[Dovecot] RAID1+md concat+XFS as mailstorage
Hello! somewhere in maillist I've seen RAID1+md concat+XFS being promoted as mailstorage. Does anybody in here actually use this setup? I've decided to give it a try, but ended up with not being able to recover any data off survived pairs from linear array when _the_first of raid1 pairs got down. thanks!
Re: [Dovecot] RAID1+md concat+XFS as mailstorage
Note that you wouldn't get anything back from a similar fail of a RAID10 array either I wasn't aware of it, that's interesting. (unless we are talking temporary removal and re-insertion?) nope, I'm talking about complete pair's crash when two disks die. I do understand that's the possibility of such outcome (when two disks in the same pair crash) is not high, but when we have 12 or 24 disks in storage... -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Ed W Sent: Thursday, June 28, 2012 11:15 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] RAID1+md concat+XFS as mailstorage On 28/06/2012 13:01, Костырев Александр Алексеевич wrote: Hello! somewhere in maillist I've seen RAID1+md concat+XFS being promoted as mailstorage. Does anybody in here actually use this setup? I've decided to give it a try, but ended up with not being able to recover any data off survived pairs from linear array when _the_first of raid1 pairs got down. This is the configuration endorsed by Stan Hoeppner. His description of the benefits is quite compelling, but real world feedback is interesting to achieve. Note that you wouldn't get anything back from a similar fail of a RAID10 array either (unless we are talking temporary removal and re-insertion?) Ed W
Re: [Dovecot] RAID1+md concat+XFS as mailstorage
- RAID1 pairs, plus some kind of intelligent overlay filesystem, eg md-linear+XFS / BTRFS. With the filesystem aware of the underlying arrangement it can theoretically optimise file placement and dramatically increase write speeds for small files in the same manner that RAID-0 theoretically achieves. (However, still no protection against silent single drive corruption unless btrfs perhaps adds this in the future?) not only silent single drive corruption problem but as I stated in start of topic - crash of first pair.
Re: [Dovecot] Dovecot proxy/director and mail pop3/imap backend serviceon same server
I've already tortured Timo about that. check this thread out: http://www.dovecot.org/list/dovecot/2012-June/066315.html -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Aerion Stevens Sent: Friday, June 22, 2012 4:50 PM To: dovecot@dovecot.org Subject: [Dovecot] Dovecot proxy/director and mail pop3/imap backend serviceon same server Hi all, I am interested in running a Dovecot Proxy(with Director) on the same server as the main Dovecot IMAP/POP3 service. I have a basic Proxy/Director configuration working, however I am struggling with getting the Proxy and IMAP/POP3 service to coexist on the same server. I plan to use three IMAP/POP3 servers with a NFS/maildir backend, and I am playing with Dovecot 2.1.5 at the moment. I have two seperate configurations, one for the Proxy/Director and one for the Dovecot IMAP/POP3 mail backend servers. For this to work my thoughts are that I will need to run the Proxy/Director imap/pop3 login process on the standard ports 143, 110, 993, 995 and for the Dovecot IMAP/POP3 mail backend service running on the same server will need to use different ports (I decided to be 9143, 9110, 9993, 9995 for example). How do I tell the director to proxy incoming imap/pop3 connection to the mail backend servers running on ports 9143, 9110, 9993, 9995 rather than the default imap/pop3 ports? Using the default ports will clearly cause loops. Can anyone kindly provide an example snippet of config that tells the director to use different port for IMAP and POP3 proxy? I have so far found the following pages helpful to what I am working on: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy http://wiki2.dovecot.org/PasswordDatabase/ExtraFields http://wiki2.dovecot.org/Director Cheers, Aerion.
Re: [Dovecot] GlusterFS + Dovecot
We've considered using gluster for our mail storage a month ago. I've seen index corruption even if mail was delivered by lmtp sequentially some split-brains with no clear reason with more than 2000 mails in box we had to wait for 40sec to open mailbox through roundcube, so we've decided to go for dsync replication instead with common mysql database for user storage and imap/pop3/lmtp proxy. -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Romer Ventura Sent: Thursday, June 21, 2012 2:51 AM To: dovecot@dovecot.org Subject: [Dovecot] GlusterFS + Dovecot Hello, Has anyone used GlusterFS as storage file system for dovecot or any other email system..? It says that it can be presented as a NFS, CIFS and as GlusterFS using the native client, technically using the client would allow the machine to read and write to it, therefore, I think that Dovecot would not care about it. Correct? Anyone out there used this setup?? Thanks.
[Dovecot] director map and mysql
hello!
Is doveadm director map command suppose to work when I store host value in
mysql table?
It gives me nothing in output with no errors in log.
I've successfully setup directors with static passdb, and decided to give a try
setup with storing host value in mysql table.
The proxying is actually working, I'm just unhappy with no output from doveadm
director map.
on the other hand output from doveadm director map is not empty, when I
configure my password_query not to return host from table.
director's settings in dovecot.sql is:
passdb {
driver = sql
args = /etc/dovecot/dovecot-sql.conf
}
userdb {
driver = sql
args = /etc/dovecot/dovecot-sql.conf
}
director_servers = 192.168.5.125
director_mail_servers = 192.168.5.110 192.168.5.111
service doveadm {
inet_listener {
port = 24245
}
}
protocol doveadm {
auth_socket_path = director-userdb
}
doveadm_proxy_port = 24245
in /etc/dovecot/dovecot-sql.conf at director there's
password_query = SELECT \
NULL AS password,\
'Y' as nopassword, \
'Y' AS proxy, \
MBOX_NAME as user, \
host2 as host \
from M_MAILBOX \
where MBOX_NAME = '%u'
user_query = SELECT \
MBOX_NAME AS username, \
MAIL_DIRECTORY as home \
from M_MAILBOX \
where MBOX_NAME = '%u';
iterate_query = select MBOX_NAME AS username from M_MAILBOX;
backend's conf:
service doveadm {
inet_listener {
port = 24245
}
}
Re: [Dovecot] director map and mysql
thanks! but what mechanisms do I have if I want certain user to be always proxied to certain host, but if that host is down, to redirect him to another? I planned to setup two dovecot storage servers where all mailboxes are mirrored between these two servers with dsync replication like described in http://www.dovecot.org/list/dovecot/2012-March/064243.html but I don't want this user to be redirected to two these servers in round-robin fashion. -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Timo Sirainen Sent: Wednesday, June 20, 2012 1:22 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] director map and mysql On 20.6.2012, at 5.03, Костырев Александр Алексеевич wrote: Is doveadm director map command suppose to work when I store host value in mysql table? It gives me nothing in output with no errors in log. If you return a host for a user, then Dovecot does regular proxying and director doesn't know anything about the user.
[Dovecot] director: non standart ports at backends
hello,
I'm trying to figure out how to proxy pop3 and pop3s that listens on
non-standart ports at backends.
For example, pop3 is at 1110 and pop3s at 1995 (on backend side).
is it possible?
how should I separate this ports in director's config?
it's easy for one port:
for example lmtp - you just use passdb in protocol lmtp {}
Re: [Dovecot] director: non standart ports at backends
thanks Timo, for you time
but I still don't get it)
should I return port with just port_num1,port_num2 value or how?
I've tried to google an example but with no success.
-Original Message-
From: Timo Sirainen [mailto:t...@iki.fi]
Sent: Monday, June 11, 2012 11:01 PM
To: Костырев Александр Алексеевич
Cc: dovecot@dovecot.org
Subject: Re: [Dovecot] director: non standart ports at backends
On 11.6.2012, at 12.27, Костырев Александр Алексеевич wrote:
hello,
I'm trying to figure out how to proxy pop3 and pop3s that listens on
non-standart ports at backends.
For example, pop3 is at 1110 and pop3s at 1995 (on backend side).
is it possible?
how should I separate this ports in director's config?
it's easy for one port:
for example lmtp - you just use passdb in protocol lmtp {}
The passdb needs to return the port field. You can't use static passdb for
this, since it has no conditionals and you can't do per-port configuration.
Maybe use sqlite (simply to use it as a scripting engine - empty database) or
checkpassword as your passdb.
[Dovecot] director userdb problem
hello !
I'm trying to get users from dovecot director server:
doveadm director map
doveadm(root): Error: User listing returned failure
doveadm(root): Error: user listing failed
usermail server
ip expire time
unknown
192.168.5.101 2012-06-10 21:54:06
in logs I get:
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): mysql(172.5.14.1):
Connected to database EXIM
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Warning: mysql: Query
failed, retrying: Table 'EXIM.users' doesn't exist
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Error: sql: Iterate
query failed: Table 'EXIM.users' doesn't exist (using built-in default
iterate_query: SELECT username, domain FROM users)
in my dovecot.conf I have:
userdb {
driver = sql
args = /etc/dovecot/dovecot-sql.conf
}
passdb {
driver = static
args = proxy=y nopassword=y
}
and in /etc/dovecot/dovecot-sql.conf:
user_query = select MBOX_NAME AS user from M_MAILBOX WHERE (MBOX_NAME = '%u');
Do I have to use special table named users ? is it hard-coded?
Re: [Dovecot] director userdb problem
It seemed I had to add something like that in dovecot-sql.conf
iterate_query = select MBOX_NAME AS username from M_MAILBOX WHERE MBOX_NAME =
'%n';
so I did but I'm still getting no usernames
so I enabled general_log in mysql
that what I get:
select MBOX_NAME AS username from M_MAILBOX WHERE MBOX_NAME = ''
It seems like direcotor don't expand variables, I've tried both - %n and %u -
nothing
any help ?
-Original Message-
From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On
Behalf Of Костырев Александр Алексеевич
Sent: Sunday, June 10, 2012 9:49 PM
To: dovecot@dovecot.org
Subject: [Dovecot] director userdb problem
hello !
I'm trying to get users from dovecot director server:
doveadm director map
doveadm(root): Error: User listing returned failure
doveadm(root): Error: user listing failed
usermail server
ip expire time
unknown
192.168.5.101 2012-06-10 21:54:06
in logs I get:
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): mysql(172.5.14.1):
Connected to database EXIM
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Warning: mysql: Query
failed, retrying: Table 'EXIM.users' doesn't exist
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Error: sql: Iterate
query failed: Table 'EXIM.users' doesn't exist (using built-in default
iterate_query: SELECT username, domain FROM users)
in my dovecot.conf I have:
userdb {
driver = sql
args = /etc/dovecot/dovecot-sql.conf
}
passdb {
driver = static
args = proxy=y nopassword=y
}
and in /etc/dovecot/dovecot-sql.conf:
user_query = select MBOX_NAME AS user from M_MAILBOX WHERE (MBOX_NAME = '%u');
Do I have to use special table named users ? is it hard-coded?
Re: [Dovecot] director userdb problem [solved]
Faxe on #dovecot helped me:
iterate_query = select MBOX_NAME AS username from M_MAILBOX; with no where
clause
sorry for wasting your time.
--
С уважением,
Костырев Александр
системный администратор
ЗАО Сервер-Центр
тел.: (423) 262-02-62 (доб. 2037)
факс: (423) 262-02-10
a.kosty...@serverc.ru
icq: 404-198-497
-Original Message-
From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On
Behalf Of Костырев Александр Алексеевич
Sent: Sunday, June 10, 2012 10:05 PM
To: dovecot@dovecot.org
Subject: Re: [Dovecot] director userdb problem
It seemed I had to add something like that in dovecot-sql.conf
iterate_query = select MBOX_NAME AS username from M_MAILBOX WHERE MBOX_NAME =
'%n';
so I did but I'm still getting no usernames
so I enabled general_log in mysql
that what I get:
select MBOX_NAME AS username from M_MAILBOX WHERE MBOX_NAME = ''
It seems like direcotor don't expand variables, I've tried both - %n and %u -
nothing
any help ?
-Original Message-
From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On
Behalf Of Костырев Александр Алексеевич
Sent: Sunday, June 10, 2012 9:49 PM
To: dovecot@dovecot.org
Subject: [Dovecot] director userdb problem
hello !
I'm trying to get users from dovecot director server:
doveadm director map
doveadm(root): Error: User listing returned failure
doveadm(root): Error: user listing failed
usermail server
ip expire time
unknown
192.168.5.101 2012-06-10 21:54:06
in logs I get:
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): mysql(172.5.14.1):
Connected to database EXIM
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Warning: mysql: Query
failed, retrying: Table 'EXIM.users' doesn't exist
Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Error: sql: Iterate
query failed: Table 'EXIM.users' doesn't exist (using built-in default
iterate_query: SELECT username, domain FROM users)
in my dovecot.conf I have:
userdb {
driver = sql
args = /etc/dovecot/dovecot-sql.conf
}
passdb {
driver = static
args = proxy=y nopassword=y
}
and in /etc/dovecot/dovecot-sql.conf:
user_query = select MBOX_NAME AS user from M_MAILBOX WHERE (MBOX_NAME = '%u');
Do I have to use special table named users ? is it hard-coded?
[Dovecot] director: backend health monitoring
Hello! I am wonder if there are plans to include backend health monitoring feature to Dovecot Director ? Yes, I'm aware of poolmon by Brad Davidson but I think it's kind of must-have feature out of box. thanks
[Dovecot] Director pop3 real ips v2.1.1
good day! I'm experiencing problem with pop3 proxying: on backend servers in logs there's director's ip instead of remote's like this: Jun 8 15:21:23 host-01 dovecot: pop3-login: Login: user=te...@example.com, method=PLAIN, rip=192.168.5.102, lip=192.168.5.100, mpid=26170, secured Jun 8 15:32:16 host-01 dovecot: pop3-login: Login: user=te...@example.com, method=PLAIN, rip=192.168.5.102, lip=192.168.5.100, mpid=26426, secured -- С уважением, Костырев Александр системный администратор ЗАО Сервер-Центр тел.: (423) 262-02-62 (доб. 2037) факс: (423) 262-02-10 a.kosty...@serverc.ru icq: 404-198-497
Re: [Dovecot] Director pop3 real ips v2.1.1
*sorry, accidently send to soon. continue: but with imap it's ok I've read thread Dovecot Proxy and environment variables and as I understood there was no solution. yes, I use v.2.1.1 on both director and backends and yes, I've added login_trusted_networks = 192.168.5.0/24 on all of them but it didn't help. any workarounds? thanks -- С уважением, Костырев Александр системный администратор ЗАО Сервер-Центр тел.: (423) 262-02-62 (доб. 2037) факс: (423) 262-02-10 a.kosty...@serverc.ru icq: 404-198-497 -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Костырев Александр Алексеевич Sent: Friday, June 08, 2012 3:33 PM To: dovecot@dovecot.org Subject: [Dovecot] Director pop3 real ips v2.1.1 good day! I'm experiencing problem with pop3 proxying: on backend servers in logs there's director's ip instead of remote's like this: Jun 8 15:21:23 host-01 dovecot: pop3-login: Login: user=te...@example.com, method=PLAIN, rip=192.168.5.102, lip=192.168.5.100, mpid=26170, secured Jun 8 15:32:16 host-01 dovecot: pop3-login: Login: user=te...@example.com, method=PLAIN, rip=192.168.5.102, lip=192.168.5.100, mpid=26426, secured -- С уважением, Костырев Александр системный администратор ЗАО Сервер-Центр тел.: (423) 262-02-62 (доб. 2037) факс: (423) 262-02-10 a.kosty...@serverc.ru icq: 404-198-497
Re: [Dovecot] best practises for mail systems
I think LVS is just fine and it is not a SPOF 'cause it is actually 2 servers: active master -- and standby slave. LVS supports real time replication of connections from master to slave, so if master dies slave knows which IP was connected to which dovecot server. I'm more worried about right design of mailstorage.. should I use some cluster fs with all mail of all users or should I split mailstorage across servers and somehow avoid long downtime if one of servers goes down. -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Matthias-Christian Ott Sent: Tuesday, June 05, 2012 11:28 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] best practises for mail systems On 2012-06-05 05:14, Костырев Александр Алексеевич wrote: On each host system we created one VM and passed through 3x2TB disks into it. In guests vms on top of this disks we made XFS and fired up glusterfs with distributed replicated volumes for our mailstorage. so it looks like this: vm1replicate vm2 disk1 disk4 disk2 disk5 disk3 disk6 in each vm we mounted glusterfs and pointed dovecot to that dir for mail creation (as ltmp) and imap4 user access. also we use exim as smtp. So, with glusterfs as mailstorage we can go for LVS to load balancing for exim and dovecot. so wherenever one of host systems (hence one of mail vms) goes down, users don't notice that 'cause LVS points them to working smtp and imap4 servers and they get their mail 'cause of glusterfs. [...] Cons: - not quite sure if glusterfs is production ready solution 'cause I've experienced split-brains during setting it up - IO performance issue. Though we didn't yet run any io tests, but glusterfs uses fuse to mount on clients. And guys on #gluster told me writing to the glusterfs mount will not be strictly local io. I'm not familiar with LVS, but from the project description it seems that you need a front server that does the load balancing, so you either have to run at least two of these servers in parallel or add to your cons that you introduced a single point of failure. But you mentioned that you only have two servers, so you really can do this. I would rather ensure high availability by running the two servers as masters and using either IP address takeover or DNS failover (with dynamic DNS) and either use Dovecot's replication (I haven't tested it yet and I'm not sure what happens in case of IP address takeover) or a file system that can handle these kinds of errors (e.g. Coda). You could do load balancing via round-robin DNS. This only protects you against the failure of single machine and because IMAP sessions are not replicated between the servers, connections will get reset if one server fails, but it's cost-effective and uses software that already exists. Regards, Matthias-Christian
[Dovecot] best practises for mail systems
hello! Can someone point me to some best practices in building high-available scalable mail system or! share your own success stories. I've read article in LJ Building a Scalable High-Availability E-Mail System with Active Directory and More but it seemed to be outdated and there's a single point of failure (Master node). What I want to achieve: high-available, horizontaly scalable, with no single point of failure mail solution. Available hardware: intel mfsys25 modular server with 2 storage controllers, 2 switches, 4 power supply blocks with - 2 blade-servers in mfsys with: 2xIntel Xeon E5620 @ 2.40GHz with 8 cores each - promise vtrak e610s (2 storage controllers, 2 power supply blocks) - 6x 2TB SATA Hitachi HDS72302 We decided to go for KVM virtualization and glusterfs for live migration for vm image but that's not what this is all about :) We installed centos on host systems. for now while we could think of two ways to go: The first way (currently at testing stage): On each host system we created one VM and passed through 3x2TB disks into it. In guests vms on top of this disks we made XFS and fired up glusterfs with distributed replicated volumes for our mailstorage. so it looks like this: vm1 replicate vm2 disk1 disk4 disk2 disk5 disk3 disk6 in each vm we mounted glusterfs and pointed dovecot to that dir for mail creation (as ltmp) and imap4 user access. also we use exim as smtp. So, with glusterfs as mailstorage we can go for LVS to load balancing for exim and dovecot. so wherenever one of host systems (hence one of mail vms) goes down, users don't notice that 'cause LVS points them to working smtp and imap4 servers and they get their mail 'cause of glusterfs. Pros: - high-available - horizontaly scalable - with no single point of failure Cons: - not quite sure if glusterfs is production ready solution 'cause I've experienced split-brains during setting it up - IO performance issue. Though we didn't yet run any io tests, but glusterfs uses fuse to mount on clients. And guys on #gluster told me writing to the glusterfs mount will not be strictly local io. The second way: split up the users mail with: two back-end VMs each other on DIFFERENT host system with - fat mailstorage with raid1+linear mode (mdadm)+XFS - dovecot/exim-back-ends and two VMs for nginx-based proxy servers for imap4 and smtp - nginx can redirect user to right back-end through HTTP-php-based logic. Pros: - we split up not only load for exim/dovecot but users mail IOs too - no split-brains Cons: - If one of the host systems (hence one of back-end VMs with storage) goes down, half of our users is unhappy P.S. Sorry if this place is way wrong to ask for such things.
[Dovecot] Authentication mechanism and Password scheme
Good day! I'm just trying to figure out that my understanding of subject is correct. So, if I want to store passwords in my database encrypted with SSHA512 scheme, my only choice for Authentication mechanism is plaintext? Thanks in advance! -- С уважением, Костырев Александр системный администратор ЗАО Сервер-Центр тел.: (423) 262-02-62 (доб. 2037) факс: (423) 262-02-10
Re: [Dovecot] debug user's message retrieval
It seems like it’s what I looked for.
Many thanks!
--
-Original Message-
From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On
Behalf Of Urban Loesch
Sent: Friday, September 09, 2011 5:30 PM
To: Dovecot Mailing List
Subject: Re: [Dovecot] debug user's message retrieval
Hi,
perhaps the mail_log plugin can help you.
# mail_log plugin provides more event logging for mail processes.
plugin {
# Events to log. Also available: flag_change append
mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename
# Group events within a transaction to one line.
mail_log_group_events = no
# Available fields: uid, box, msgid, from, subject, size, vsize, flags
# size and vsize are available only for expunge and copy events.
mail_log_fields = uid box msgid size from
}
...
Regards
Urban
Костырев Александр Алексеевич wrote:
I forgot to mention that when I go to user's directory there's no
letters at all.
On Fri, 2011-09-09 at 13:30 +1100, Костырев Александр Алексеевич wrote:
Hi there!
Is there any method to log user's activity with pop3 service?
I'll try to explain situation:
In maillog I saw that my dovecot lmtp saved four letters in user's
mailbox.
After a while I got a call from that user saying that he received
nothing.
Is there any method to log that that user RETR every single letter,
maybe with full names of letter's id or something like that?
Re: [Dovecot] debug user's message retrieval
Yep, I do have info like that but I need more cowbell) -Original Message- From: dovecot-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On Behalf Of Joseba Torre Sent: Friday, September 09, 2011 7:38 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] debug user's message retrieval On Viernes 09 Septiembre 2011 04:36:13 Костырев Александр Алексеевич escribió: I forgot to mention that when I go to user's directory there's no letters at all. On Fri, 2011-09-09 at 13:30 +1100, Костырев Александр Алексеевич wrote: Hi there! Is there any method to log user's activity with pop3 service? I'll try to explain situation: In maillog I saw that my dovecot lmtp saved four letters in user's mailbox. After a while I got a call from that user saying that he received nothing. Is there any method to log that that user RETR every single letter, maybe with full names of letter's id or something like that? The default pop3 log is enough for me: Sep 9 05:46:37 server1 dovecot: POP3(user1): Disconnected: Logged out top=0/0, retr=1/41706, del=1/1, size=41685 This means that user1 received 1 message, deleted 1 message, and total downloaded size was 41685. Don't you have a similar line for your user? -- Joseba Torre. Vicegerencia de TICs, área de Explotación
[Dovecot] debug user's message retrieval
Hi there! Is there any method to log user's activity with pop3 service? I'll try to explain situation: In maillog I saw that my dovecot lmtp saved four letters in user's mailbox. After a while I got a call from that user saying that he received nothing. Is there any method to log that that user RETR every single letter, maybe with full names of letter's id or something like that?
Re: [Dovecot] debug user's message retrieval
I forgot to mention that when I go to user's directory there's no letters at all. On Fri, 2011-09-09 at 13:30 +1100, Костырев Александр Алексеевич wrote: Hi there! Is there any method to log user's activity with pop3 service? I'll try to explain situation: In maillog I saw that my dovecot lmtp saved four letters in user's mailbox. After a while I got a call from that user saying that he received nothing. Is there any method to log that that user RETR every single letter, maybe with full names of letter's id or something like that? -- С уважением, Костырев Александр системный администратор ЗАО Сервер-Центр тел.: (423) 262-02-62 (доб. 2037) факс: (423) 262-02-10 a.kosty...@serverc.ru www.serverc.ru icq: 404-198-497
Re: [Dovecot] dovecot and maillists problem
I've sniffed traffic between exim and lmtp In log of dovecot I have: 17:17:46 msgid=e1qwtg6-0002o6...@pink.example.com: G48FNNjoVU63IwAA1nFjLA: 17:17:51 msgid=e1qwtg6-0002o6...@pink.example.com: HI8FNNjoVU63IwAA1nFjLA: 17:17:56 msgid=e1qwtg6-0002o6...@pink.example.com: gY8FNNjoVU63IwAA1nFjLA: 17:18:01 msgid=e1qwtg6-0002o6...@pink.example.com: 5o8FNNjoVU63IwAA1nFjLA: 17:18:08 msgid=e1qwtg6-0002o6...@pink.example.com: S5AFNNjoVU63IwAA1nFjLA: 17:18:13 msgid=e1qwtg6-0002o6...@pink.example.com: sJAFNNjoVU63IwAA1nFjLA: 17:18:18 msgid=e1qwtg6-0002o6...@pink.example.com: FZEFNNjoVU63IwAA1nFjLA: 17:18:23 msgid=e1qwtg6-0002o6...@pink.example.com: epEFNNjoVU63IwAA1nFjLA: 17:18:29 msgid=e1qwtg6-0002o6...@pink.example.com: 35EFNNjoVU63IwAA1nFjLA: 17:18:31 msgid=e1qwtg6-0002o6...@pink.example.com: RJIFNNjoVU63IwAA1nFjLA: Totally 10 different lmtp ids. According to wireshark while sending I've got 2 tcp streams with 5 different ids in each Log of one the streams (I've truncated DATA part - it's the same for both streams): http://pastebin.com/w4qJqZMG *note I've send message in maillist with mailx -s 'g' 2...@atlas-2.ru /boot/initrd.img-686 -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 5:01 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem I mean, my point of view of what is happening is is disagreement with the logs you showed. So something's weird here and only the LMTP traffic logs can lead to more clarity. On 25.8.2011, at 8.49, Костырев Александр Алексеевич wrote: But that kind of conflicts on your logs that show tons of SQL lookups one after another.. I'm not sure that these are conflicts. As I see it, it's legitimate lookups for the users who are the members of maillist I thought that's correct behavior, am I wrong? -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 4:36 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem On 25.8.2011, at 8.17, Костырев Александр Алексеевич wrote: The problem is: When I send a letter to short maillist (as above) it get the same ID and stored only once in the maildir of one user who is the member of that maillist - that's ok, but When I send a letter to maillist with a large number of recipients it occurred that it's saved more than one, because of the headers added by dovecot lmtp (I've changed host name): diff letter_in_one_user/1314238006.M841940P6916.pink\,S\=12778136\,W\=12953189 letler_in_second_user/new/1314237993.M460165P6916.pink\,S\=12778136\,W\=12953189 3,4c3,4 by pink.example.com (Dovecot) with LMTP id 6UiGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:46 +1100 --- by pink.example.com (Dovecot) with LMTP id VUeGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:29 +1100 It's the same letter accept the date and id. Try capturing the LMTP traffic between Dovecot and Exim? I'm not sure if there's a good way to capture traffic from UNIX sockets, but at least if Exim and Dovecot talk via TCP there are many ways. The different LMTP ids and dates are added only when there are different DATA commands, which would mean that Exim has sent separate RCPT TO + DATA commands for each of these mails. But that kind of conflicts on your logs that show tons of SQL lookups one after another..
Re: [Dovecot] dovecot and maillists problem
Yes, Timo, you were absolutely right! if someone stucks at this: read http://exim.org/exim-html-current/doc/html/spec_html/ch30.html I had to tune max_rcpt parameter in transport section. Thank you very much! -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 6:19 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem Right, so it looks like Exim is configured to send DATA after each 100 RCPT TOs, which means Dovecot links each message 100 times. If you want it linked those ~500 times, I guess you'll need to increase some limit in Exim. On 25.8.2011, at 10.14, Костырев Александр Алексеевич wrote: I've sniffed traffic between exim and lmtp In log of dovecot I have: 17:17:46 msgid=e1qwtg6-0002o6...@pink.example.com: G48FNNjoVU63IwAA1nFjLA: 17:17:51 msgid=e1qwtg6-0002o6...@pink.example.com: HI8FNNjoVU63IwAA1nFjLA: 17:17:56 msgid=e1qwtg6-0002o6...@pink.example.com: gY8FNNjoVU63IwAA1nFjLA: 17:18:01 msgid=e1qwtg6-0002o6...@pink.example.com: 5o8FNNjoVU63IwAA1nFjLA: 17:18:08 msgid=e1qwtg6-0002o6...@pink.example.com: S5AFNNjoVU63IwAA1nFjLA: 17:18:13 msgid=e1qwtg6-0002o6...@pink.example.com: sJAFNNjoVU63IwAA1nFjLA: 17:18:18 msgid=e1qwtg6-0002o6...@pink.example.com: FZEFNNjoVU63IwAA1nFjLA: 17:18:23 msgid=e1qwtg6-0002o6...@pink.example.com: epEFNNjoVU63IwAA1nFjLA: 17:18:29 msgid=e1qwtg6-0002o6...@pink.example.com: 35EFNNjoVU63IwAA1nFjLA: 17:18:31 msgid=e1qwtg6-0002o6...@pink.example.com: RJIFNNjoVU63IwAA1nFjLA: Totally 10 different lmtp ids. According to wireshark while sending I've got 2 tcp streams with 5 different ids in each Log of one the streams (I've truncated DATA part - it's the same for both streams): http://pastebin.com/w4qJqZMG *note I've send message in maillist with mailx -s 'g' 2...@atlas-2.ru /boot/initrd.img-686 -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 5:01 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem I mean, my point of view of what is happening is is disagreement with the logs you showed. So something's weird here and only the LMTP traffic logs can lead to more clarity. On 25.8.2011, at 8.49, Костырев Александр Алексеевич wrote: But that kind of conflicts on your logs that show tons of SQL lookups one after another.. I'm not sure that these are conflicts. As I see it, it's legitimate lookups for the users who are the members of maillist I thought that's correct behavior, am I wrong? -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 4:36 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem On 25.8.2011, at 8.17, Костырев Александр Алексеевич wrote: The problem is: When I send a letter to short maillist (as above) it get the same ID and stored only once in the maildir of one user who is the member of that maillist - that's ok, but When I send a letter to maillist with a large number of recipients it occurred that it's saved more than one, because of the headers added by dovecot lmtp (I've changed host name): diff letter_in_one_user/1314238006.M841940P6916.pink\,S\=12778136\,W\=12953189 letler_in_second_user/new/1314237993.M460165P6916.pink\,S\=12778136\,W\=12953189 3,4c3,4 by pink.example.com (Dovecot) with LMTP id 6UiGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:46 +1100 --- by pink.example.com (Dovecot) with LMTP id VUeGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:29 +1100 It's the same letter accept the date and id. Try capturing the LMTP traffic between Dovecot and Exim? I'm not sure if there's a good way to capture traffic from UNIX sockets, but at least if Exim and Dovecot talk via TCP there are many ways. The different LMTP ids and dates are added only when there are different DATA commands, which would mean that Exim has sent separate RCPT TO + DATA commands for each of these mails. But that kind of conflicts on your logs that show tons of SQL lookups one after another..
[Dovecot] dovecot and maillists problem
Hello there! I have a little trouble with using dovecot as lmtp and maillists. I use dovecot 2.0.13 with exim 4.72 on Debian 6.0. (All stuff at one host). info of maillists is store in mysql table, for example: +-+-+ | name| recipients | +-+-+ | Hab_Tax | 250467-253601001.253809737...@25.example.org,2721097514-272101001.271300057...@.example.org | +-+-+ The problem is: When I send a letter to short maillist (as above) it get the same ID and stored only once in the maildir of one user who is the member of that maillist - that's ok, but When I send a letter to maillist with a large number of recipients it occurred that it's saved more than one, because of the headers added by dovecot lmtp (I've changed host name): diff letter_in_one_user/1314238006.M841940P6916.pink\,S\=12778136\,W\=12953189 letler_in_second_user/new/1314237993.M460165P6916.pink\,S\=12778136\,W\=12953189 3,4c3,4 by pink.atlas-2.ru (Dovecot) with LMTP id 6UiGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:46 +1100 --- by pink.atlas-2.ru (Dovecot) with LMTP id VUeGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:29 +1100 It's the same letter accept the date and id. What I get in logs is: I see that exim send letters in maillist with one and the same id: ...skipped... 13:06:46 1QwPKe-0001nU-U5 2...@example.org ... 13:06:47 1QwPKe-0001nU-U5 2...@example.org ... But in logs of dovecot I see: 13:06:14 msgid=e1qwpke-0001nu...@pink.example.org: wUWGJBWuVU4EGwAA1nFjLA: 13:06:18 msgid=e1qwpke-0001nu...@pink.example.org: wEWGJBWuVU4EGwAA1nFjLA: 13:06:22 msgid=e1qwpke-0001nu...@pink.example.org: JkaGJBWuVU4EGwAA1nFjLA: 13:06:26 msgid=e1qwpke-0001nu...@pink.example.org: i0aGJBWuVU4EGwAA1nFjLA: 13:06:30 msgid=e1qwpke-0001nu...@pink.example.org: 8EaGJBWuVU4EGwAA1nFjLA: 13:06:34 msgid=e1qwpke-0001nu...@pink.example.org: VUeGJBWuVU4EGwAA1nFjLA: 13:06:37 msgid=e1qwpke-0001nu...@pink.example.org: ukeGJBWuVU4EGwAA1nFjLA: 13:06:42 msgid=e1qwpke-0001nu...@pink.example.org: H0iGJBWuVU4EGwAA1nFjLA: 13:06:46 msgid=e1qwpke-0001nu...@pink.example.org: hEiGJBWuVU4EGwAA1nFjLA: 13:06:47 msgid=e1qwpke-0001nu...@pink.example.org: 6UiGJBWuVU4EGwAA1nFjLA: Also in dovecot log I've noticed that: at first auth is searching info in sql for 200 users then log continues with lmtp's info then auth is searching info in sql for another portion of users and this loop in log continues. Dovecot.conf: http://pastebin.com/ueCBU3bP dovecot.sql: http://pastebin.com/kqCq52mC dovecot.log http://pastebin.com/YiyMWpx1 exim.conf: http://pastebin.com/F4MNQkAx exim.log: http://pastebin.com/wn83TZpX
Re: [Dovecot] dovecot and maillists problem
But that kind of conflicts on your logs that show tons of SQL lookups one after another.. I'm not sure that these are conflicts. As I see it, it's legitimate lookups for the users who are the members of maillist I thought that's correct behavior, am I wrong? -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: Thursday, August 25, 2011 4:36 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem On 25.8.2011, at 8.17, Костырев Александр Алексеевич wrote: The problem is: When I send a letter to short maillist (as above) it get the same ID and stored only once in the maildir of one user who is the member of that maillist - that's ok, but When I send a letter to maillist with a large number of recipients it occurred that it's saved more than one, because of the headers added by dovecot lmtp (I've changed host name): diff letter_in_one_user/1314238006.M841940P6916.pink\,S\=12778136\,W\=12953189 letler_in_second_user/new/1314237993.M460165P6916.pink\,S\=12778136\,W\=12953189 3,4c3,4 by pink.atlas-2.ru (Dovecot) with LMTP id 6UiGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:46 +1100 --- by pink.atlas-2.ru (Dovecot) with LMTP id VUeGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:29 +1100 It's the same letter accept the date and id. Try capturing the LMTP traffic between Dovecot and Exim? I'm not sure if there's a good way to capture traffic from UNIX sockets, but at least if Exim and Dovecot talk via TCP there are many ways. The different LMTP ids and dates are added only when there are different DATA commands, which would mean that Exim has sent separate RCPT TO + DATA commands for each of these mails. But that kind of conflicts on your logs that show tons of SQL lookups one after another..
