Re: Duplicate messages if message is moved when using dsync

[Thom Pol]

Hi,

Thanks for your reply!

The dsync is triggered on IMAP/POP3/LDA/LMTP activity. See my config 
dump from the first email. I'm wondering if my config is not OK so it 
causes dsync to sync twice?



you need / preferably use a database for your user auth

I already do this.


run the command doveadm user '*' - it needs to return a list of users
that will trigger replication (after doing config above)

This part works fine.

Thanks,

Thom Pol



On 18/05/2022 16:51, Paul Kudla (SCOM.CA Internet Services Inc.) wrote:

ok - question

when you say dsync are you running that manually or as a cronjob ??

or using replication via dsync

there is a difference

replication is designed to handle mailbox changes by quing the changes
on the fly and then update in the background.

replication tracks all changes in a mailbox and then sends them one at a
time to the target server.

i run replication with tcp (not tcps or dsync)

I find (other then the 300+folder issues) that it runs pretty good in
real time.

if you are running dsync manually then yes timing on its own will be a
hit and miss and it will never sync properly if something appears during
the dsync process.

if you have the sive running as discussed that is the first step

you should setup replication so things are handled in real time.

pls advise if you have already done replication or just manually dsyncing.

Below is basic replication setup but you need to make sure various
pre-requirements are in place a head of time.

1. you need / preferably use a database for your user auth

 you need to setup an iterate sql statement that returns the user
 list of users to be replicated

Example (i use pgsql) :

# cat dovecot-pgsql.conf
driver = pgsql
connect = host=localhost port=5433 dbname=scom_billing user=pgsql password=
default_pass_scheme = PLAIN

password_query = SELECT username as user, password FROM email_users
WHERE username = '%u' and password <> 'alias' and status = True and
destination = '%u'

user_query = SELECT home, uid, gid FROM email_users WHERE username =
'%u' and password <> 'alias' and status = True and destination = '%u'

iterate_query = SELECT "username" as user, domain FROM email_users WHERE
status = True and alias_flag = False

#iterate_query  above is what returns the user lists

2. run the command doveadm user '*' - it needs to return a list of users
that will trigger replication (after doing config above)

3. in general here is my relative parts for tcp replication

In dovecot.conf

---

mail_plugins = " virtual notify replication fts fts_lucene "

replication_dsync_parameters = -d -N -l 300 -U

dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u

plugin {

.
mail_replica = tcp:10.221.0.19:12345

#(note this is the ip address of the other server)
#it is the only config change ie server one above
#server2 would be the other server for communicating.



.

}

protocol imap {
mail_max_userip_connections = 50
mail_plugins = $mail_plugins notify replication
}

protocol pop3 {
mail_max_userip_connections = 50
mail_plugins = $mail_plugins notify replication
}

protocol imaps {
mail_max_userip_connections = 25
mail_plugins = $mail_plugins notify replication
}

protocol pop3s {
mail_max_userip_connections = 25
mail_plugins = $mail_plugins notify replication
}

replication_max_conns = 100 (optional)

replication_full_sync_interval = 1d

service replicator {
client_limit = 0
drop_priv_before_exec = no
idle_kill = 4294967295s
process_limit = 1
process_min_avail = 0
service_count = 0
vsz_limit = 8g
  unix_listener replicator-doveadm {
  mode = 0600
  user = vmail
}
vsz_limit = 8192M
}

service aggregator {
process_limit = 1000
#vsz_limit = 1g
fifo_listener replication-notify-fifo {
  user = vmail
  group = vmail
  mode = 0666
}

}





that should do it?












Happy Wednesday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main?1.866.411.7266
Fax?1.888.892.7266

Re: Duplicate messages if message is moved when using dsync

[Paul Kudla (SCOM.CA Internet Services Inc.)]

ok - question

when you say dsync are you running that manually or as a cronjob ??

or using replication via dsync

there is a difference

replication is designed to handle mailbox changes by quing the changes 
on the fly and then update in the background.


replication tracks all changes in a mailbox and then sends them one at a 
time to the target server.


i run replication with tcp (not tcps or dsync)

I find (other then the 300+folder issues) that it runs pretty good in 
real time.


if you are running dsync manually then yes timing on its own will be a 
hit and miss and it will never sync properly if something appears during 
the dsync process.


if you have the sive running as discussed that is the first step

you should setup replication so things are handled in real time.

pls advise if you have already done replication or just manually dsyncing.

Below is basic replication setup but you need to make sure various 
pre-requirements are in place a head of time.


1. you need / preferably use a database for your user auth

   you need to setup an iterate sql statement that returns the user
   list of users to be replicated

Example (i use pgsql) :

# cat dovecot-pgsql.conf
driver = pgsql
connect = host=localhost port=5433 dbname=scom_billing user=pgsql password=
default_pass_scheme = PLAIN

password_query = SELECT username as user, password FROM email_users 
WHERE username = '%u' and password <> 'alias' and status = True and 
destination = '%u'


user_query = SELECT home, uid, gid FROM email_users WHERE username = 
'%u' and password <> 'alias' and status = True and destination = '%u'


iterate_query = SELECT "username" as user, domain FROM email_users WHERE 
status = True and alias_flag = False


#iterate_query  above is what returns the user lists

2. run the command doveadm user '*' - it needs to return a list of users 
that will trigger replication (after doing config above)


3. in general here is my relative parts for tcp replication

In dovecot.conf

---

mail_plugins = " virtual notify replication fts fts_lucene "

replication_dsync_parameters = -d -N -l 300 -U

dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u

plugin {

.
  mail_replica = tcp:10.221.0.19:12345

#(note this is the ip address of the other server)
#it is the only config change ie server one above
#server2 would be the other server for communicating.



.

}

protocol imap {
  mail_max_userip_connections = 50
  mail_plugins = $mail_plugins notify replication
}

protocol pop3 {
  mail_max_userip_connections = 50
  mail_plugins = $mail_plugins notify replication
}

protocol imaps {
  mail_max_userip_connections = 25
  mail_plugins = $mail_plugins notify replication
}

protocol pop3s {
  mail_max_userip_connections = 25
  mail_plugins = $mail_plugins notify replication
}

replication_max_conns = 100 (optional)

replication_full_sync_interval = 1d

service replicator {
  client_limit = 0
  drop_priv_before_exec = no
  idle_kill = 4294967295s
  process_limit = 1
  process_min_avail = 0
  service_count = 0
  vsz_limit = 8g
unix_listener replicator-doveadm {
mode = 0600
user = vmail
  }
  vsz_limit = 8192M
}

service aggregator {
  process_limit = 1000
  #vsz_limit = 1g
  fifo_listener replication-notify-fifo {
user = vmail
group = vmail
mode = 0666
  }

}





that should do it?












Happy Wednesday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services 
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main 1.866.411.7266
Fax 1.888.892.7266

On 5/18/2022 3:39 PM, Thom Pol wrote:
Never mind. It did not work, issue still exists. I guess my network was 
a little slower when I thought it worked, so the emails were moved by my 
local client only after the sync had already happened between the servers.


So, back to the original message. Anyone any idea how this moving on 
local client while the remote servers are still running the dsync can 
work correctly without getting a duplicate?


Kind regards,

Thom Pol



On 18/05/2022 16:24, Paul Kudla (SCOM.CA Internet Services Inc.) wrote:

Your Welcome



Happy Wednesday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main?1.866.411.7266
Fax?1.888.892.7266


--
This message has been scanned for viruses and
dangerous content by *MailScanner* , and is
believed to be clean.

Re: Duplicate messages if message is moved when using dsync

[Thom Pol]

Never mind. It did not work, issue still exists. I guess my network was 
a little slower when I thought it worked, so the emails were moved by my 
local client only after the sync had already happened between the servers.


So, back to the original message. Anyone any idea how this moving on 
local client while the remote servers are still running the dsync can 
work correctly without getting a duplicate?


Kind regards,

Thom Pol



On 18/05/2022 16:24, Paul Kudla (SCOM.CA Internet Services Inc.) wrote:

Your Welcome



Happy Wednesday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main?1.866.411.7266
Fax?1.888.892.7266

Re: Duplicate messages if message is moved when using dsync

[Paul Kudla (SCOM.CA Internet Services Inc.)]

ok duplicsate emails (even across dsync, replication etc) is typically 
handled via a global sieve script



I use :

# cat duplicates.sieve
require "duplicate";   # for dovecot >= 2.2.18

if duplicate {
discard;
stop;
}

for the scripts

and setup sieve to work via my dovecot.conf file

relative parts below :



protocols = imap pop3 lmtp sieve

protocol lmtp {
  mail_plugins = $mail_plugins sieve
  postmaster_address = moni...@scom.ca
}


protocol lda {
  mail_plugins = $mail_plugins sieve
}


plugin {
.

  sieve = file:~/sieve;active=~/sieve/.dovecot.sieve

  sieve_duplicate_default_period = 1h
  sieve_duplicate_max_period = 1d
  sieve_extensions = +duplicate +notify +imapflags +vacation-seconds
  sieve_global_dir = /usr/local/etc/dovecot/sieve
  sieve_before = /usr/local/etc/dovecot/sieve/duplicates.sieve

.
}

service managesieve-login {
  process_limit = 1000
  vsz_limit = 1g
  inet_listener sieve {
port = 4190
  }
}

protocol sieve {
  managesieve_implementation_string = Dovecot Pigeonhole
  managesieve_max_line_length = 65536
}



--


note the sieve_before which handles duplictes during delivery etc.


Happy Monday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services <http://www.scom.ca>
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main 1.866.411.7266
Fax 1.888.892.7266

On 5/15/2022 12:38 PM, Thom Pol wrote:

Hi,

Hope you are well.

We have a cluster of 2 Dovecot servers, both on v2.3.13 (89f716dc2), 
using dsync to sync the messages between them.


Previously, we used TCPS to sync the messages, but after some testing, 
we concluded that syncing over SSH resulted in a lot less failed syncs, 
so we started using SSH.


The change has been a success, but I now notice a issue when a email 
client immediately moves a messages to a separate folder while Dovecot 
is syncing, where the message is seen twice in the folder (with the 
exact same headers/content).


For example, I have set a filter in my email client, Thunderbird, to 
immediately move all emails coming from this list to a separate folder. 
When opening that folder, I do not see one, but two unread messages, 
both identical to each other.


When checking the directories on the server, I see this:
mx1:
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M180050P1376677.mx1,S=19089,W=19384:2,S

mx2:
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M981426P990530.mx2,S=19089,W=19384:2,S
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S

Note the difference: on mx1, one indicates mx1, and one mx2, while on 
the other server, both indicate mx2/


Any idea (other then telling end-users not to use such filters) how we 
could prevent these duplicate messages?


This is our config:
# Pigeonhole version 0.5.13 (cdd19fe3)
# OS: Linux 5.10.0-13-cloud-amd64 x86_64 Debian 11.3
# Hostname: mx1.example.com
auth_mechanisms = plain login
disable_plaintext_auth = no
dsync_remote_cmd = ssh -p 222 -l%{login} %{host} doveadm dsync-server -u%u
imap_capability = +SPECIAL-USE XLIST
listen = *,[::]
lmtp_rcpt_check_quota = yes
log_timestamp = "%Y-%m-%d %H:%M:%S "
mail_max_userip_connections = 100
mail_plugins = quota
mail_privileged_group = vmail
namespace inbox {
   inbox = yes
   location =
   mailbox Drafts {
     special_use = \Drafts
   }
   mailbox Junk {
     special_use = \Junk
   }
   mailbox Sent {
     special_use = \Sent
   }
   mailbox "Sent Messages" {
     special_use = \Sent
   }
   mailbox Trash {
     special_use = \Trash
   }
   prefix =
   separator = .
}
passdb {
   args = /etc/dovecot/dovecot-sql.conf
   driver = sql
}
plugin {
   mail_replica = remote:r...@mx2.example.com
   quota = dict:user::file:/var/vmail/%d/%n/.quotausage
   quota_status_nouser = DUNNO
   quota_status_overquota = 552 5.2.2 Mailbox is full
   quota_status_success = DUNNO
   sieve = /var/vmail/%d/%n/.sieve
   sieve_after = /var/vmail/%d/%n/.ispconfig.sieve
   sieve_before = /var/vmail/%d/%n/.ispconfig-before.sieve
   sieve_max_actions = 100
   sieve_max_redirects = 25
   sieve_max_script_size = 2M
}
protocols = imap pop3 lmtp
replication_max_conns = 50
service aggregator {
   fifo_listener replication-notify-fifo {
     mode = 0666
     user = vmail
   }
   unix_listener replication-notify {
     mode = 0666
     user = vmail
   }
}
service auth {
   unix_listener /var/spool/postfix/private/auth {
     group = postfix
     mode = 0660
     user = postfix
   }
   unix_listener auth-userdb {
     group = vmail
     mode = 0600
     user = vmail
   }
   user = root
}
service imap-login {
   client_limit = 1000
   process_limit = 512
}
service lmt

Duplicate messages if message is moved when using dsync

[Thom Pol]

Hi,

Hope you are well.

We have a cluster of 2 Dovecot servers, both on v2.3.13 (89f716dc2), 
using dsync to sync the messages between them.


Previously, we used TCPS to sync the messages, but after some testing, 
we concluded that syncing over SSH resulted in a lot less failed syncs, 
so we started using SSH.


The change has been a success, but I now notice a issue when a email 
client immediately moves a messages to a separate folder while Dovecot 
is syncing, where the message is seen twice in the folder (with the 
exact same headers/content).


For example, I have set a filter in my email client, Thunderbird, to 
immediately move all emails coming from this list to a separate folder. 
When opening that folder, I do not see one, but two unread messages, 
both identical to each other.


When checking the directories on the server, I see this:
mx1:
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M180050P1376677.mx1,S=19089,W=19384:2,S

mx2:
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615811.M981426P990530.mx2,S=19089,W=19384:2,S
/var/vmail/example.com/joe/Maildir/.Subdir.Subdir/cur/1652615808.M190190P990486.mx2,S=19089,W=19384:2,S

Note the difference: on mx1, one indicates mx1, and one mx2, while on 
the other server, both indicate mx2/


Any idea (other then telling end-users not to use such filters) how we 
could prevent these duplicate messages?


This is our config:
# Pigeonhole version 0.5.13 (cdd19fe3)
# OS: Linux 5.10.0-13-cloud-amd64 x86_64 Debian 11.3
# Hostname: mx1.example.com
auth_mechanisms = plain login
disable_plaintext_auth = no
dsync_remote_cmd = ssh -p 222 -l%{login} %{host} doveadm dsync-server -u%u
imap_capability = +SPECIAL-USE XLIST
listen = *,[::]
lmtp_rcpt_check_quota = yes
log_timestamp = "%Y-%m-%d %H:%M:%S "
mail_max_userip_connections = 100
mail_plugins = quota
mail_privileged_group = vmail
namespace inbox {
  inbox = yes
  location =
  mailbox Drafts {
    special_use = \Drafts
  }
  mailbox Junk {
    special_use = \Junk
  }
  mailbox Sent {
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Trash {
    special_use = \Trash
  }
  prefix =
  separator = .
}
passdb {
  args = /etc/dovecot/dovecot-sql.conf
  driver = sql
}
plugin {
  mail_replica = remote:r...@mx2.example.com
  quota = dict:user::file:/var/vmail/%d/%n/.quotausage
  quota_status_nouser = DUNNO
  quota_status_overquota = 552 5.2.2 Mailbox is full
  quota_status_success = DUNNO
  sieve = /var/vmail/%d/%n/.sieve
  sieve_after = /var/vmail/%d/%n/.ispconfig.sieve
  sieve_before = /var/vmail/%d/%n/.ispconfig-before.sieve
  sieve_max_actions = 100
  sieve_max_redirects = 25
  sieve_max_script_size = 2M
}
protocols = imap pop3 lmtp
replication_max_conns = 50
service aggregator {
  fifo_listener replication-notify-fifo {
    mode = 0666
    user = vmail
  }
  unix_listener replication-notify {
    mode = 0666
    user = vmail
  }
}
service auth {
  unix_listener /var/spool/postfix/private/auth {
    group = postfix
    mode = 0660
    user = postfix
  }
  unix_listener auth-userdb {
    group = vmail
    mode = 0600
    user = vmail
  }
  user = root
}
service imap-login {
  client_limit = 1000
  process_limit = 512
}
service lmtp {
  unix_listener /var/spool/postfix/private/dovecot-lmtp {
    group = postfix
    mode = 0600
    user = postfix
  }
}
service quota-status {
  client_limit = 1
  executable = quota-status -p postfix
  unix_listener /var/spool/postfix/private/quota-status {
    group = postfix
    mode = 0660
    user = postfix
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
    mode = 0666
    user = vmail
  }
}
service stats {
  unix_listener stats-reader {
    group = vmail
    mode = 0660
    user = vmail
  }
  unix_listener stats-writer {
    group = vmail
    mode = 0660
    user = vmail
  }
}
ssl_cert = ssl_cipher_list = 
kEECDH:+kEECDH+SHA:kEDH:+kEDH+SHA:+kEDH+CAMELLIA:kECDH:+kECDH+SHA:kRSA:+kRSA+SHA:+kRSA+CAMELLIA:!aNULL:!eNULL:!SSLv2:!RC4:!MD5:!DES:!EXP:!SEED:!IDEA:!3DES

ssl_client_ca_dir = /etc/ssl/certs
ssl_dh = # hidden, use -P to show it
ssl_key = # hidden, use -P to show it
ssl_min_protocol = TLSv1.2
ssl_prefer_server_ciphers = yes
userdb {
  driver = prefetch
}
userdb {
  args = /etc/dovecot/dovecot-sql.conf
  driver = sql
}
protocol imap {
  auth_verbose = yes
  mail_plugins = quota quota imap_quota quota notify replication
}
protocol pop3 {
  auth_verbose = yes
  mail_plugins = quota quota quota notify replication
  pop3_uidl_format = %08Xu%08Xv
}
protocol lda {
  mail_plugins = quota sieve quota sieve quota notify replication
  postmaster_address = postmas...@mx1.example.com
}
protocol lmtp {
  mail_plugins = quota quota sieve sieve quota notify replication
  postmaster_address = postmas...@mx1.example.com
}

Thanks in advance for your thoughts.

Kind regards,

Thom Pol

Re: Trying to track down source of duplicate messages

[Steffen Kaiser via dovecot]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Tue, 2 Apr 2019, Timo Sirainen via dovecot wrote:

succeeded eventually. You might see these differences in Received 
headers.


yep, post the Received lines

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQEVAwUBXKNd4sQnQQNheMxiAQI8pAf+M0SIuJ2qeqEJVluvGixTXyG8LgApMfAg
8r4irnUQryWmvg8jRUp/xVtVLtzhC3eI6Suz0RQoo6ggFoxgnaVKEeVDLSSBugmb
RV1yjngjW0G4kiGTLcUc2yak3avvGnmWQmX2BgoadpWJ2e7Rn5j1VhuYBz9sQg2j
UYqFqhIZBHz7sjuhWfJY7ApMGf0C4Rttbi4/8O8gaGw/y9Z3xJO1WBOXElW39J71
S7V3GKjI/xY3dvRffjstw3n4Hf3qVGAn1Q3fEx/aXc7UVJ3mBM+Jg6LIXMux2YSw
6v+w5k5W28EA9MMZlfiJYzgi0y/U1T1PE0SQmBzDefOvok5KifUrBg==
=gL5U
-END PGP SIGNATURE-

Re: Trying to track down source of duplicate messages

[Timo Sirainen via dovecot]

On 1 Apr 2019, at 19.40, Alex via dovecot  wrote:
> 
> Hi,
> 
> I haven't received any responses to my duplicate messages problem. It
> occurred to me that I posted my full dovecot config instead of just
> the changes we've made locally. I thought it might help to follow up
> with just the specific config to make it easier to identify a
> potential problem.

How are you delivering the mails? With dovecot-lda or something else? Do you 
see any errors/warnings in your MTA log? Similar problems at least can happen 
if the delivery takes a very long time and MTA times out and retries the 
delivery later on, but the original delivery actually succeeded eventually. You 
might see these differences in Received headers.

Re: Trying to track down source of duplicate messages

[Aki Tuomi via dovecot]

Can you try turning on mail_debug and see if you can reproduce the duplicate 
email issue?

Aki

> On 01 April 2019 at 19:40 Alex via dovecot  wrote:
> 
> 
> Hi,
> 
> I haven't received any responses to my duplicate messages problem. It
> occurred to me that I posted my full dovecot config instead of just
> the changes we've made locally. I thought it might help to follow up
> with just the specific config to make it easier to identify a
> potential problem.
> 
> Any ideas greatly appreciated.
> 
> # doveconf -n
> # 2.3.5 (513208660): /etc/dovecot/dovecot.conf
> # Pigeonhole version 0.5.5 (2483b085)
> # OS: Linux 4.20.11-100.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight)
> mail_gid = mail
> mail_home = mail/
> mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u
> mail_max_userip_connections = 500
> mail_plugins = " listescape"
> mail_privileged_group = mail
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope
> encoded-character vacation subaddress comparator-i;ascii-numeric
> relational regex imap4flags copy include variables body enotify
> environment mailbox date index ihave duplicate mime foreverypart
> extracttext
> mbox_write_locks = fcntl
> namespace inbox {
>   inbox = yes
>   location =
>   mailbox Drafts {
> special_use = \Drafts
>   }
>   mailbox Junk {
> special_use = \Junk
>   }
>   mailbox Sent {
> special_use = \Sent
>   }
>   mailbox "Sent Messages" {
> special_use = \Sent
>   }
>   mailbox Trash {
> special_use = \Trash
>   }
>   prefix =
> }
> passdb {
>   driver = pam
> }
> passdb {
>   driver = pam
> }
> protocols = imap pop3
> service auth {
>   unix_listener /var/spool/postfix/private/auth {
> group = postfix
> mode = 0660
> user = postfix
>   }
> }
> service imap-login {
>   inet_listener imap {
> port = 0
>   }
>   inet_listener imaps {
> port = 993
>   }
>   process_min_avail = 20
>   service_count = 0
> }
> service pop3-login {
>   inet_listener pop3 {
> port = 0
>   }
>   inet_listener pop3s {
> address = 192.168.1.100
> port = 995
>   }
> }
> ssl_cert =  ssl_cipher_list =
> ALL:!LOW:!EXP:!aNULL:!RC4::!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS
> ssl_dh = # hidden, use -P to show it
> ssl_key = # hidden, use -P to show it
> ssl_prefer_server_ciphers = yes
> userdb {
>   driver = passwd
> }
> userdb {
>   driver = passwd
> }
> 
> On Sat, Mar 30, 2019 at 4:09 PM Alex  wrote:
> >
> > Hi,
> >
> > I have a fedora28 system with dovecot-2.3.5 and I'm trying to figure
> > out why I'm increasingly receiving duplicate emails. The message IDs
> > are exactly the same. It's always two of the same messages. I don't
> > think it's ever occurred in the inbox. It doesn't happen with every
> > message or seemingly in every folder.
> >
> > I've read about dovecot deduplicate, but of course I want to prevent
> > them from being duplicated in the first place. It's also happening
> > much more frequently now.
> >
> > Could something in my configuration cause this problem?
> >
> > Below is the contents of my doveconf
> >

Re: Trying to track down source of duplicate messages

[Alex via dovecot]

Hi,

I haven't received any responses to my duplicate messages problem. It
occurred to me that I posted my full dovecot config instead of just
the changes we've made locally. I thought it might help to follow up
with just the specific config to make it easier to identify a
potential problem.

Any ideas greatly appreciated.

# doveconf -n
# 2.3.5 (513208660): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.5 (2483b085)
# OS: Linux 4.20.11-100.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight)
mail_gid = mail
mail_home = mail/
mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u
mail_max_userip_connections = 500
mail_plugins = " listescape"
mail_privileged_group = mail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date index ihave duplicate mime foreverypart
extracttext
mbox_write_locks = fcntl
namespace inbox {
  inbox = yes
  location =
  mailbox Drafts {
special_use = \Drafts
  }
  mailbox Junk {
special_use = \Junk
  }
  mailbox Sent {
special_use = \Sent
  }
  mailbox "Sent Messages" {
special_use = \Sent
  }
  mailbox Trash {
special_use = \Trash
  }
  prefix =
}
passdb {
  driver = pam
}
passdb {
  driver = pam
}
protocols = imap pop3
service auth {
  unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0660
user = postfix
  }
}
service imap-login {
  inet_listener imap {
port = 0
  }
  inet_listener imaps {
port = 993
  }
  process_min_avail = 20
  service_count = 0
}
service pop3-login {
  inet_listener pop3 {
port = 0
  }
  inet_listener pop3s {
address = 192.168.1.100
port = 995
  }
}
ssl_cert =  wrote:
>
> Hi,
>
> I have a fedora28 system with dovecot-2.3.5 and I'm trying to figure
> out why I'm increasingly receiving duplicate emails. The message IDs
> are exactly the same. It's always two of the same messages. I don't
> think it's ever occurred in the inbox. It doesn't happen with every
> message or seemingly in every folder.
>
> I've read about dovecot deduplicate, but of course I want to prevent
> them from being duplicated in the first place. It's also happening
> much more frequently now.
>
> Could something in my configuration cause this problem?
>
> Below is the contents of my doveconf
>

Trying to track down source of duplicate messages

[Alex via dovecot]

Hi,

I have a fedora28 system with dovecot-2.3.5 and I'm trying to figure
out why I'm increasingly receiving duplicate emails. The message IDs
are exactly the same. It's always two of the same messages. I don't
think it's ever occurred in the inbox. It doesn't happen with every
message or seemingly in every folder.

I've read about dovecot deduplicate, but of course I want to prevent
them from being duplicated in the first place. It's also happening
much more frequently now.

Could something in my configuration cause this problem?

Below is the contents of my doveconf

# 2.3.5 (513208660): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.5 (2483b085)
# OS: Linux 4.20.11-100.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight)
# Hostname: orion.inside.guardiandigital.com
# NOTE: Send doveconf -n output instead when asking for help.
auth_anonymous_username = anonymous
auth_cache_negative_ttl = 1 hours
auth_cache_size = 0
auth_cache_ttl = 1 hours
auth_cache_verify_password_with_worker = no
auth_debug = no
auth_debug_passwords = no
auth_default_realm =
auth_failure_delay = 2 secs
auth_gssapi_hostname =
auth_krb5_keytab =
auth_master_user_separator =
auth_mechanisms = plain
auth_policy_check_after_auth = yes
auth_policy_check_before_auth = yes
auth_policy_hash_mech = sha256
auth_policy_hash_nonce =
auth_policy_hash_truncate = 12
auth_policy_log_only = no
auth_policy_reject_on_fail = no
auth_policy_report_after_auth = yes
auth_policy_request_attributes = login=%{requested_username}
pwhash=%{hashed_password} remote=%{rip} device_id=%{client_id}
protocol=%s
auth_policy_server_api_header =
auth_policy_server_timeout_msecs = 2000
auth_policy_server_url =
auth_proxy_self =
auth_realms =
auth_socket_path = auth-userdb
auth_ssl_require_client_cert = no
auth_ssl_username_from_cert = no
auth_stats = no
auth_use_winbind = no
auth_username_chars =
abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@
auth_username_format = %Lu
auth_username_translation =
auth_verbose = no
auth_verbose_passwords = no
auth_winbind_helper_path = /usr/bin/ntlm_auth
auth_worker_max_count = 30
base_dir = /var/run/dovecot
config_cache_size = 1 M
debug_log_path =
default_client_limit = 1000
default_idle_kill = 1 mins
default_internal_group = dovecot
default_internal_user = dovecot
default_login_user = dovenull
default_process_limit = 100
default_vsz_limit = 256 M
deliver_log_format = msgid=%m: %$
dict_db_config =
director_flush_socket =
director_mail_servers =
director_max_parallel_kicks = 100
director_max_parallel_moves = 100
director_output_buffer_size = 10 M
director_ping_idle_timeout = 30 secs
director_ping_max_timeout = 1 mins
director_servers =
director_user_expire = 15 mins
director_user_kick_delay = 2 secs
director_username_hash = %u
disable_plaintext_auth = yes
dotlock_use_excl = yes
doveadm_allowed_commands =
doveadm_api_key =
doveadm_http_rawlog_dir =
doveadm_password =
doveadm_port = 0
doveadm_socket_path = doveadm-server
doveadm_username = doveadm
doveadm_worker_count = 0
dsync_alt_char = _
dsync_commit_msgs_interval = 100
dsync_features =
dsync_hashed_headers = Date Message-ID
dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -U
first_valid_gid = 1
first_valid_uid = 500
haproxy_timeout = 3 secs
haproxy_trusted_networks =
hostname =
imap_capability =
imap_client_workarounds =
imap_fetch_failure = disconnect-immediately
imap_hibernate_timeout = 0
imap_id_log =
imap_id_retain = no
imap_id_send = name *
imap_idle_notify_interval = 2 mins
imap_literal_minus = no
imap_logout_format = in=%i out=%o deleted=%{deleted}
expunged=%{expunged} trashed=%{trashed} hdr_count=%{fetch_hdr_count}
hdr_bytes=%{fetch_hdr_bytes} body_count=%{fetch_body_count}
body_bytes=%{fetch_body_bytes}
imap_max_line_length = 64 k
imap_metadata = no
imap_urlauth_host =
imap_urlauth_logout_format = in=%i out=%o
imap_urlauth_port = 143
imapc_cmd_timeout = 5 mins
imapc_connection_retry_count = 1
imapc_connection_retry_interval = 1 secs
imapc_features =
imapc_host =
imapc_list_prefix =
imapc_master_user =
imapc_max_idle_time = 29 mins
imapc_max_line_length = 0
imapc_password =
imapc_port = 143
imapc_rawlog_dir =
imapc_sasl_mechanisms =
imapc_ssl = no
imapc_ssl_verify = yes
imapc_user =
import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID LISTEN_FDS
info_log_path =
instance_name = dovecot
last_valid_gid = 0
last_valid_uid = 0
lda_mailbox_autocreate = no
lda_mailbox_autosubscribe = no
lda_original_recipient_header =
libexec_dir = /usr/libexec/dovecot
listen = *, ::
lmtp_hdr_delivery_address = final
lmtp_proxy = no
lmtp_proxy_rawlog_dir =
lmtp_rawlog_dir =
lmtp_rcpt_check_quota = no
lmtp_save_to_detail_mailbox = no
lmtp_user_concurrency_limit = 0
lock_method = fcntl
log_core_filter =
log_debug =
log_path = syslog
log_timestamp = "%b %d %H:%M:%S "
login_access_sockets =
login_greeting = Dovecot ready.
login_log_format = %$: %s
login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e
%c session=<%{session}>
login_plugin_dir = 

R: Re: Duplicate messages

[absolutely_f...@libero.it]

Hi Miloš,
unfortunately, I have no X-UIDL header in my mailboxes.
Thank you


Messaggio originale
Da: ghostlovescor...@gmail.com
Data: 13/12/2014 10.25
A: absolutely_f...@libero.itabsolutely_f...@libero.it, dovecot@dovecot.
org
Ogg: Re: Duplicate messages

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 12/12/14 09:39, absolutely_f...@libero.it wrote:
 Hi, I just moved mail spool to a different network storage. Now,
 several users are complaining about duplicate message that are
 fetched by their clients (Outlook, Microsoft Outlook). What is the
 reason?
 
 This is my conf:
 
 # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux
 2.6.32-71.el6.x86_64 x86_64 CentOS release 6.6 (Final) 
 auth_mechanisms = plain login digest-md5 cram-md5 
 disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid =
 89 mail_gid = 89 mail_location = maildir:/coraid-s2l2/domains 
 mail_uid = 89 managesieve_notify_capability = mailto 
 managesieve_sieve_capability = fileinto reject envelope
 encoded-character vacation subaddress comparator-i;ascii-numeric
 relational regex imap4flags copy include variables body enotify
 environment mailbox date imapflags notify mbox_write_locks = fcntl 
 namespace { inbox = yes location = prefix = INBOX. separator = . 
 type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext 
 driver = sql } passdb { args =
 /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } plugin { 
 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions =
 +notify +imapflags sieve_max_script_size = 1M } protocols = imap
 pop3 lmtp sieve ssl_cert = /etc/nginx/ssl/wildcard.server.net.crt 
 ssl_key = /etc/nginx/ssl/wildcard.server.net.key userdb { args =
 /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { 
 mail_plugins = } protocol lda { mail_plugins = }
 
Hello,

Please check if those users have X-UIDL header in their emails. If do,
remove header. That should solve the problem.

Regards,
Miloš
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJUjAYJAAoJEBkMFHhDgrs5LgAH/2uTkvRPLr0LEme+srIk72cw
F5yYiH17K7vaPERTPrmKWZGtpezylWK/7YevjCE44+60L8JZqmIVQ99JRZcvMfSh
KP5qu7A41EVXSsAiB75NfTcUEMAYYRSZHpu2rl9lFnGA+5zH9DCqSQrzyatF/DAl
pdmLHVDH4Cj9rNAVdEl5u1e3rC0VCV3xXGgIBkIR9wdIhtrzW7Bdt2Ove08ct93t
Uqj7mhtTxxBoUU2fDzkLZRdCSQpf8HiaKcgWQPNIcRGM0i+hbw42Sgwyl0XFiXfx
f9YxPcT8OahF1+lCnVvQXhR2TiLTbBn+nFN7yWkrNkPlqs8lfIh1t9JOzldrO48=
=YCbh
-END PGP SIGNATURE-

Re: Duplicate messages

[Miloš Dukić]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 12/12/14 09:39, absolutely_f...@libero.it wrote:
 Hi, I just moved mail spool to a different network storage. Now,
 several users are complaining about duplicate message that are
 fetched by their clients (Outlook, Microsoft Outlook). What is the
 reason?
 
 This is my conf:
 
 # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux
 2.6.32-71.el6.x86_64 x86_64 CentOS release 6.6 (Final) 
 auth_mechanisms = plain login digest-md5 cram-md5 
 disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid =
 89 mail_gid = 89 mail_location = maildir:/coraid-s2l2/domains 
 mail_uid = 89 managesieve_notify_capability = mailto 
 managesieve_sieve_capability = fileinto reject envelope
 encoded-character vacation subaddress comparator-i;ascii-numeric
 relational regex imap4flags copy include variables body enotify
 environment mailbox date imapflags notify mbox_write_locks = fcntl 
 namespace { inbox = yes location = prefix = INBOX. separator = . 
 type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext 
 driver = sql } passdb { args =
 /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } plugin { 
 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions =
 +notify +imapflags sieve_max_script_size = 1M } protocols = imap
 pop3 lmtp sieve ssl_cert = /etc/nginx/ssl/wildcard.server.net.crt 
 ssl_key = /etc/nginx/ssl/wildcard.server.net.key userdb { args =
 /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { 
 mail_plugins = } protocol lda { mail_plugins = }
 
Hello,

Please check if those users have X-UIDL header in their emails. If do,
remove header. That should solve the problem.

Regards,
Miloš
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJUjAYJAAoJEBkMFHhDgrs5LgAH/2uTkvRPLr0LEme+srIk72cw
F5yYiH17K7vaPERTPrmKWZGtpezylWK/7YevjCE44+60L8JZqmIVQ99JRZcvMfSh
KP5qu7A41EVXSsAiB75NfTcUEMAYYRSZHpu2rl9lFnGA+5zH9DCqSQrzyatF/DAl
pdmLHVDH4Cj9rNAVdEl5u1e3rC0VCV3xXGgIBkIR9wdIhtrzW7Bdt2Ove08ct93t
Uqj7mhtTxxBoUU2fDzkLZRdCSQpf8HiaKcgWQPNIcRGM0i+hbw42Sgwyl0XFiXfx
f9YxPcT8OahF1+lCnVvQXhR2TiLTbBn+nFN7yWkrNkPlqs8lfIh1t9JOzldrO48=
=YCbh
-END PGP SIGNATURE-

Re: R: Re: R: Re: Duplicate messages

[Steffen]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

absolutely_f...@libero.it wrote:

 I simply copied data between two folders
 
 I mounted both network storage on this server. After that, I
 used:
 
 # nice -n 19 rsync -av --progress /mnt/old/domains/*
 /var/spool/pop/domains/

if an user was connected to the Maildir the same time you've
duplicated the Maildir, there were changes of the flags, messages
moved from .../new to .../cur or from one mailbox to another. So you
have some possibilities, where the duplicate messages com from.

If these reasons are the ones in your case, nobody knows.

 On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:
 

 On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:

 I just moved mail spool to a different network
 storage. Now, several users are complaining about
 duplicate message that are
 fetched
 by their clients (Outlook, Microsoft Outlook).
 What is the reason?
 
 How did you moved the message to the other network
 storage?
 
 mail_location = maildir:/coraid-s2l2/domains

- -- 
Steffen
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (Darwin)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iQEVAwUBVIxudnD1/YhP6VMHAQIOxggA39/H4NjYPYV6n5S2rLy8TcuQ5QmKb1on
AJz3Hl/0MY8mi5Xzsgf6lSaV08HckwxMbhXkM7qi8/QWAsmhVNf3m0+YfJEPYyMt
f0ndjqvhVApbDrseN1Cpg/MAHYiz+4wTJ4OsO1SuLOahG5+f7QhRPVf+6wxscgL+
rXd4OaDV2oHj8fxWeOu5k9M0fOTdbP/GDRsvZvA4I+2Qy5dHgE7YmFfTvtA071f5
H2W9dbitCGPhzfF2PbogaI3Py5CCVK2b1e7CdGiJKzGkAoQK5ypiEiYb1L35m4QA
xj3ZU1ckilx6XBwRQxvPkcH+pQvOjbhDs7A0M6a0k0HkU8v4Yz5WKg==
=Mf1M
-END PGP SIGNATURE-

Duplicate messages

[absolutely_f...@libero.it]

Hi,
I just moved mail spool to a different network storage.
Now, several users are complaining about duplicate message that are fetched by 
their clients (Outlook, Microsoft Outlook).
What is the reason?

This is my conf:

# dovecot -n
# 2.0.9: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.32-71.el6.x86_64 x86_64 CentOS release 6.6 (Final)
auth_mechanisms = plain login digest-md5 cram-md5
disable_plaintext_auth = no
first_valid_gid = 89
first_valid_uid = 89
mail_gid = 89
mail_location = maildir:/coraid-s2l2/domains
mail_uid = 89
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character 
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy 
include variables body enotify environment mailbox date imapflags notify
mbox_write_locks = fcntl
namespace {
  inbox = yes
  location =
  prefix = INBOX.
  separator = .
  type = private
}
passdb {
  args = /etc/dovecot/dovecot-sql.conf.ext
  driver = sql
}
passdb {
  args = /etc/dovecot/dovecot-sql-crypt.conf.ext
  driver = sql
}
plugin {
  sieve = ~/.dovecot.sieve
  sieve_dir = ~/sieve
  sieve_extensions = +notify +imapflags
  sieve_max_script_size = 1M
}
protocols = imap pop3 lmtp sieve
ssl_cert = /etc/nginx/ssl/wildcard.server.net.crt
ssl_key = /etc/nginx/ssl/wildcard.server.net.key
userdb {
  args = /etc/dovecot/dovecot-sql.conf.ext
  driver = sql
}
protocol lmtp {
  mail_plugins =
}
protocol lda {
  mail_plugins =
}

Re: Duplicate messages

[Steffen Kaiser]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:


Hi,
I just moved mail spool to a different network storage.
Now, several users are complaining about duplicate message that are fetched by 
their clients (Outlook, Microsoft Outlook).
What is the reason?


How did you moved the message to the other network storage?


mail_location = maildir:/coraid-s2l2/domains


- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0
Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1
fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+
yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv
y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE
rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw==
=qlBd
-END PGP SIGNATURE-

R: Re: Duplicate messages

[absolutely_f...@libero.it]

Hi Steffen,
with rsync 

Thank you


Messaggio originale
Da: skdove...@smail.inf.fh-brs.de
Data: 12/12/2014 9.44
A: absolutely_f...@libero.itabsolutely_f...@libero.it
Cc: dovecot@dovecot.org
Ogg: Re: Duplicate messages

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:
 
 Hi,
 I just moved mail spool to a different network storage.
 Now, several users are complaining about duplicate message that are fetched 
by their clients (Outlook, Microsoft Outlook).
 What is the reason?

How did you moved the message to the other network storage?

 mail_location = maildir:/coraid-s2l2/domains

- -- 
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0
Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1
fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+
yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv
y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE
rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw==
=qlBd
-END PGP SIGNATURE-

Re: R: Re: Duplicate messages

[Steffen Kaiser]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:


with rsync


would you be more specific:

which command line, how did you shut users out etc.pp.




Messaggio originale
Da: skdove...@smail.inf.fh-brs.de
Data: 12/12/2014 9.44
A: absolutely_f...@libero.itabsolutely_f...@libero.it
Cc: dovecot@dovecot.org
Ogg: Re: Duplicate messages

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:


Hi,
I just moved mail spool to a different network storage.
Now, several users are complaining about duplicate message that are fetched

by their clients (Outlook, Microsoft Outlook).

What is the reason?


How did you moved the message to the other network storage?


mail_location = maildir:/coraid-s2l2/domains


- --
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0
Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1
fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+
yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv
y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE
rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw==
=qlBd
-END PGP SIGNATURE-





- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIrK9Xz1H7kL/d9rAQL6BQgAjKW48XJ21iPtZ+fTZgxEC00uA7cjvwZM
EYV9wThONbvP6zCLsbjKPOCiWX4f9NwHobgkkTIBtGogF0obNvUY2tiIRWRzwGO0
31M/53iJ7ORNy9IZg3u5r1NPcklXhsjuy4cWyj13jN2FhY2xHJGqJWujtM5dCAe0
Qq3KDH0yvJQSMJIMF2Eb4M59xD6hvXMR7qSH3ShI8DxUa0JSg7hlSTKM4Ak54dPb
GObJBiAqR9TUJ5lBFvoxmt2EyAnl4h0YURdwfuCyv+vYkP0GVat5p9hHRUPDc3cU
k4MrgdcVDJI5+VMzKOhcovEZ3o2k5ChGXIdzHjvp79VB1VyZsvViyQ==
=QeMJ
-END PGP SIGNATURE-

R: Re: R: Re: Duplicate messages

[absolutely_f...@libero.it]

Hi,

I mounted both network storage on this server.
After that, I used:

# nice -n 19 rsync -av --progress /mnt/old/domains/* /var/spool/pop/domains/


Messaggio originale
Da: skdove...@smail.inf.fh-brs.de
Data: 12/12/2014 12.01
A: absolutely_f...@libero.itabsolutely_f...@libero.it
Cc: dovecot@dovecot.org
Ogg: Re: R: Re: Duplicate messages

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:

 with rsync

would you be more specific:

which command line, how did you shut users out etc.pp.


 Messaggio originale
 Da: skdove...@smail.inf.fh-brs.de
 Data: 12/12/2014 9.44
 A: absolutely_f...@libero.itabsolutely_f...@libero.it
 Cc: dovecot@dovecot.org
 Ogg: Re: Duplicate messages

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:

 Hi,
 I just moved mail spool to a different network storage.
 Now, several users are complaining about duplicate message that are 
fetched
 by their clients (Outlook, Microsoft Outlook).
 What is the reason?

 How did you moved the message to the other network storage?

 mail_location = maildir:/coraid-s2l2/domains

 - --
 Steffen Kaiser
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.11 (GNU/Linux)

 iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0
 Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1
 fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+
 yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv
 y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE
 rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw==
 =qlBd
 -END PGP SIGNATURE-



- -- 
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIrK9Xz1H7kL/d9rAQL6BQgAjKW48XJ21iPtZ+fTZgxEC00uA7cjvwZM
EYV9wThONbvP6zCLsbjKPOCiWX4f9NwHobgkkTIBtGogF0obNvUY2tiIRWRzwGO0
31M/53iJ7ORNy9IZg3u5r1NPcklXhsjuy4cWyj13jN2FhY2xHJGqJWujtM5dCAe0
Qq3KDH0yvJQSMJIMF2Eb4M59xD6hvXMR7qSH3ShI8DxUa0JSg7hlSTKM4Ak54dPb
GObJBiAqR9TUJ5lBFvoxmt2EyAnl4h0YURdwfuCyv+vYkP0GVat5p9hHRUPDc3cU
k4MrgdcVDJI5+VMzKOhcovEZ3o2k5ChGXIdzHjvp79VB1VyZsvViyQ==
=QeMJ
-END PGP SIGNATURE-

R: Re: R: Re: Duplicate messages

[absolutely_f...@libero.it]

Sorry, I haven't shut users.
I simply copied data between two folders



Messaggio originale
Da: absolutely_f...@libero.it
Data: 12/12/2014 13.14
A: dovecot@dovecot.org
Ogg: R: Re: R: Re: Duplicate messages

Hi,

I mounted both network storage on this server.
After that, I used:

# nice -n 19 rsync -av --progress /mnt/old/domains/* /var/spool/pop/domains/


Messaggio originale
Da: skdove...@smail.inf.fh-brs.de
Data: 12/12/2014 12.01
A: absolutely_f...@libero.itabsolutely_f...@libero.it
Cc: dovecot@dovecot.org
Ogg: Re: R: Re: Duplicate messages

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:

 with rsync

would you be more specific:

which command line, how did you shut users out etc.pp.


 Messaggio originale
 Da: skdove...@smail.inf.fh-brs.de
 Data: 12/12/2014 9.44
 A: absolutely_f...@libero.itabsolutely_f...@libero.it
 Cc: dovecot@dovecot.org
 Ogg: Re: Duplicate messages

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On Fri, 12 Dec 2014, absolutely_f...@libero.it wrote:

 Hi,
 I just moved mail spool to a different network storage.
 Now, several users are complaining about duplicate message that are 
fetched
 by their clients (Outlook, Microsoft Outlook).
 What is the reason?

 How did you moved the message to the other network storage?

 mail_location = maildir:/coraid-s2l2/domains

 - --
 Steffen Kaiser
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.11 (GNU/Linux)

 iQEVAwUBVIqq2Xz1H7kL/d9rAQJqJgf/ZYLDY6IwdTcSUFXRdFlvyv37QW/R0fm0
 Ki8izVuOHRNK2/YEubN2+TVouOD7X3COkYa8RCu8XSoWRiFKSl0PMHNsVqUIocA1
 fEQOnY54nmdERsZ/+w8xLW5UZ2jKH12X3gqjMSFXUvMbvlhOCZFgvlckCx/DStC+
 yjCM5yoOR711KXrhEzikr1lmxyR+kikh1N+MTLNkC3uQp0vFmWJR3HoXd3x+p+Dv
 y0PkOZmna+B8a1ElGDYA8SyGVvVl2VT+YzGt7IPhZPB5j/CrW2Kcwm2j9OW0IWnE
 rPuhY/5xqZoSUuGBGNXeA6bLy0gidnnZO7NpkMJgZcP6OnK612tMgw==
 =qlBd
 -END PGP SIGNATURE-



- -- 
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBVIrK9Xz1H7kL/d9rAQL6BQgAjKW48XJ21iPtZ+fTZgxEC00uA7cjvwZM
EYV9wThONbvP6zCLsbjKPOCiWX4f9NwHobgkkTIBtGogF0obNvUY2tiIRWRzwGO0
31M/53iJ7ORNy9IZg3u5r1NPcklXhsjuy4cWyj13jN2FhY2xHJGqJWujtM5dCAe0
Qq3KDH0yvJQSMJIMF2Eb4M59xD6hvXMR7qSH3ShI8DxUa0JSg7hlSTKM4Ak54dPb
GObJBiAqR9TUJ5lBFvoxmt2EyAnl4h0YURdwfuCyv+vYkP0GVat5p9hHRUPDc3cU
k4MrgdcVDJI5+VMzKOhcovEZ3o2k5ChGXIdzHjvp79VB1VyZsvViyQ==
=QeMJ
-END PGP SIGNATURE-

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Ed W]

On 05/09/2012 11:58, Charles Marcus wrote:

I know, it is on my ToDo list... we only just recently migrated this 
server to Dovecot, and I've had my plate full with other issues, which 
are now mostly resolved, so I'm about ready to circle back and finish 
up (installing SOGo, enabling sieve, etc),


I have recently noticed owncloud (even has an ebuild for it).  Have you 
re-evaluated roundcube+owncloud vs SOGo for a dav calender/contacts 
solution?


Ed

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Charles Marcus]

On 2012-09-04 5:57 PM, Reindl Harald h.rei...@thelounge.net wrote:

better use SIEVE filters on the server


I know, it is on my ToDo list... we only just recently migrated this 
server to Dovecot, and I've had my plate full with other issues, which 
are now mostly resolved, so I'm about ready to circle back and finish up 
(installing SOGo, enabling sieve, etc), but I need to spin up a new 
Gentoo VM first, because I want to get the current server moved over to 
our new VMWare environment.


--

Best regards,

Charles

[Dovecot] Anyone else seeing lots of random duplicate messages???

[Charles Marcus]

Almost every message I'm getting through this list is duplicated, down 
to the same exact message-ID...


Anyone else seeing this?

Charles

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Charles Marcus]

On 2012-09-04 12:37 PM, Charles Marcus cmar...@media-brokers.com wrote:
Almost every message I'm getting through this list is duplicated, down 
to the same exact message-ID...


Anyone else seeing this? 


Even this one was duplicated...

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Phil Turmel]

On 09/04/2012 12:40 PM, Charles Marcus wrote:
 On 2012-09-04 12:37 PM, Charles Marcus cmar...@media-brokers.com wrote:
 Almost every message I'm getting through this list is duplicated, down
 to the same exact message-ID...

 Anyone else seeing this? 
 
 Even this one was duplicated...

Not here :-)

Phil

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Stan Hoeppner]

On 9/4/2012 11:37 AM, Charles Marcus wrote:
 Almost every message I'm getting through this list is duplicated, down
 to the same exact message-ID...
 
 Anyone else seeing this?

Nope.  Make any changes to Postfix or your script recently?

-- 
Stan

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[/dev/rob0]

On Tue, Sep 04, 2012 at 12:40:48PM -0400, Charles Marcus wrote:
 On 2012-09-04 12:37 PM, Charles Marcus cmar...@media-brokers.com 
 wrote:
 Almost every message I'm getting through this list is duplicated,
 down to the same exact message-ID...
 
 Anyone else seeing this?
 
 Even this one was duplicated...

I think you're seeing double. Check to see if someone spiked your 
coffee. :)
-- 
  http://rob0.nodns4.us/ -- system administration and consulting
  Offlist GMX mail is seen only if /dev/rob0 is in the Subject:

On Tue, Sep 04, 2012 at 12:40:48PM -0400, Charles Marcus wrote:
 On 2012-09-04 12:37 PM, Charles Marcus cmar...@media-brokers.com 
 wrote:
 Almost every message I'm getting through this list is duplicated,
 down to the same exact message-ID...
 
 Anyone else seeing this?
 
 Even this one was duplicated...

I think you're seeing double. Check to see if someone spiked your 
coffee. :)
-- 
  http://rob0.nodns4.us/ -- system administration and consulting
  Offlist GMX mail is seen only if /dev/rob0 is in the Subject:

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Charles Marcus]

On 9/4/2012 1:07 PM, Stan Hoeppner s...@hardwarefreak.com wrote:

On 9/4/2012 11:37 AM, Charles Marcus wrote:

Almost every message I'm getting through this list is duplicated, down
to the same exact message-ID...

Anyone else seeing this?


Nope.  Make any changes to Postfix or your script recently?


Nope... but, your reply made me actually take a closer look...

It is only happening for emails that are filtered to folders (like my 
lists)...


And now I realize it must be because I've been keeping Thunderbird open 
at two separate locations (we just opened another office about 5 minutes 
away, and I have an office/computer at both), and each has filtering 
enabled...


I'll disable filtering on one, and see if that solves the problem (I 
expect it will)...


Sorry for the noise...

--

Best regards,

Charles

Re: [Dovecot] Anyone else seeing lots of random duplicate messages???

[Reindl Harald]

Am 04.09.2012 23:02, schrieb Charles Marcus:
 On 9/4/2012 1:07 PM, Stan Hoeppner s...@hardwarefreak.com wrote:
 On 9/4/2012 11:37 AM, Charles Marcus wrote:
 Almost every message I'm getting through this list is duplicated, down
 to the same exact message-ID...

 Anyone else seeing this?

 Nope.  Make any changes to Postfix or your script recently?
 
 Nope... but, your reply made me actually take a closer look...
 
 It is only happening for emails that are filtered to folders (like my 
 lists)...
 
 And now I realize it must be because I've been keeping Thunderbird open at 
 two separate locations (we just opened
 another office about 5 minutes away, and I have an office/computer at both), 
 and each has filtering enabled...
 
 I'll disable filtering on one, and see if that solves the problem (I expect 
 it will)...

better use SIEVE filters on the server for moving list-messages to
folders instead the overhead of TB which is in fact copy (download/upload)
followed by delete

so you have no problems with concurrent clients including mobile devices






signature.asc
Description: OpenPGP digital signature

[Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17)

[Oleksii Krykun]

Trying to implement expire plugin.
expire-tool works fine. This delete expunged messages but not all of them.
I have duplicate messages in appropriate folder. These messages are from
expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc.
points to same mailbox and spam often sent to all of them.
If duplicate message is received only one entry in dovecot-uidlist is
created and only first of duplicates is deleted with expire-tool. Rest of
duolicates are not deleted.

Any suggestions.

Thanks,
Kryol

Re: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17)

[Timo Sirainen]

On 17.8.2012, at 14.24, Oleksii Krykun wrote:

 Trying to implement expire plugin.
 expire-tool works fine. This delete expunged messages but not all of them.
 I have duplicate messages in appropriate folder. These messages are from
 expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc.
 points to same mailbox and spam often sent to all of them.
 If duplicate message is received only one entry in dovecot-uidlist is
 created and only first of duplicates is deleted with expire-tool. Rest of
 duolicates are not deleted.
 
 Any suggestions.

No idea, but if it's a bug, it won't be fixed anymore in v1.2. The whole thing 
has been rewritten in v2.x. I suggest upgrade.

Re: [Dovecot] POP server migration and duplicate messages.

[Timo Sirainen]

On Thu, 2011-10-27 at 12:16 -0700, Ernie Dunbar wrote:

 From a
 random sampling, the UIDL of the messages checks out between both servers,

Completely identical UIDL output with the same order of messages? If so,
there's nothing you can do about it from Dovecot's side.

 so I really don't understand what's going on here. If this is just a bug
 in Evolution, then that means I can just go ahead with the full migration
 and hope that people aren't going to be stuck with re-downloading their
 entire mailbox which in some cases, means hundreds or thousands of
 messages.

Some clients redownload mails if you change the hostname. But I don't
know why Evolution would redownload only some of the messages but not
all.

Re: [Dovecot] Detecting duplicate messages with sieve

[Aleksandar Lazic]

On Fre 16.09.2011 15:11, Timo Sirainen wrote:

On Fri, 2011-09-16 at 00:02 +0200, Aleksandar Lazic wrote:


Detecting duplicate messages

..

Is there a similar feature in sieve


No.


or can I still use the upper setup?


I think so.


Maybe I have overseen this possibiliy but how an I execute a shell
command in LDA / Sieve?


Another question is about to add this header line in every mail.

xfilter ${REFORMAIL} -a\Lines: $LINES\


What do you need it for? But nope, I don't think there's a way to do
that with Sieve either. There's an extension to add headers, but it's
not implemented yet. And I don't think there's a way to get the number
of header lines.


Well this was for the mutt mail client.
Maildrop saves the whole line of a mail into LINES-ENV-Variable.

It was just a question, maybe a feature request ;-)

Cheers
Aleks

Re: [Dovecot] Detecting duplicate messages with sieve

[Timo Sirainen]

On Fri, 2011-09-16 at 00:02 +0200, Aleksandar Lazic wrote:

 Detecting duplicate messages
..
 Is there a similar feature in sieve 

No.

 or can I still use the upper setup?

I think so.

 Another question is about to add this header line in every mail.
 
 xfilter ${REFORMAIL} -a\Lines: $LINES\

What do you need it for? But nope, I don't think there's a way to do
that with Sieve either. There's an extension to add headers, but it's
not implemented yet. And I don't think there's a way to get the number
of header lines.

Re: [Dovecot] Duplicate messages when moving message to inbox

[franc walter]

On Sun, 30 Jan 2011 15:04:07 -0800 Ron Garret wrote:

 I am encountering a strange problem but I'm not sure if it's a dovecot 
 problem or a Mac Mail problem.  The symptom is that if I move a message from 
 a folder into my inbox the message ends up showing up as a duplicate in Mac 
 Mail.  On the server it's still just one message.

Ron,
i just tried to repeat this on my Mac (OS 10.6.6) Mail 4.4 (1082) but i have
only one mail not a duplicate.
Maybe i misunderstood, but that is what i did: i moved with webmail
(squirrelmail) an email from the SENT-Folder to the INBOX and rechecked
mails on my mac. I get then just this newly moved mail, but not two of them.
If i move it back to the SENT Folder, shortly after, it disappears in Mac
Mail like it should.

I guess this is most likely a bug or misconfiguration in Mac Mail. This mail
client is really not perfect ;-)

Regards, franc walter

[Dovecot] Duplicate messages when moving message to inbox

[Ron Garret]

Hello,

I am encountering a strange problem but I'm not sure if it's a dovecot problem 
or a Mac Mail problem.  The symptom is that if I move a message from a folder 
into my inbox the message ends up showing up as a duplicate in Mac Mail.  On 
the server it's still just one message.

This ONLY happens when I move a message IN to the inbox.  It does not happen 
when I move a message out of my inbox into a folder, or when I move a message 
between folders.

I can force a sync on Mac Mail and the duplicate is still there.  If however I 
quit Mac Mail and start it up again, the duplicate disappears.

I can move one of the duplicated messages out of my inbox into a folder and 
then back into my inbox repeatedly and end up with (apparently) an arbitrary 
number of copies of the same message.  On the server, though, there is still 
only one file.

Surely I'm not the first person to have encountered this behavior?  Does anyone 
happen to know if this is a dovecot bug or a Mac Mail bug (or, hopefully, a 
configuration problem)?

Thanks,
rg

[Dovecot] Discard duplicate messages at delivery?

[Nicolas KOWALSKI]

Hello,

I am using dovecot 1.2.9, and the sieve plugin for filtering incoming
messages into specific folders. The MTA is postfix, and deliver is
called using the mailbox_command = /usr/lib/dovecot/deliver
directive. 

Is it possible to make dovecot's deliver discard duplicate messages?

With cyrus there is a duplicatesuppression directive which works well
(http://cyrusimap.web.cmu.edu/imapd/overview.html#duplicate). With
procmail, this can be done with the following recipe, but I did not
found an equivalent for dovecot:

# One often receives duplicate messages for cross-postings to mailing
# lists, or explicit replies to a post from you in addition to the
# mailing list message.
# 
# The following recipe eliminates all duplicate messages. It tells
# formail(1) to keep a cache file of the Message-IDs of the most
# recent messages you've received. Since Message-IDs are guaranteed
# unique for distinct messages, they are ideally suited to weed out
# duplicates.
# 
:0 Wh: msgid.lock
| formail -D 65536 .saves.msgid


Thanks,
-- 
Nicolas

Re: [Dovecot] Discard duplicate messages at delivery?

[Steffen Kaiser]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Tue, 12 Jan 2010, Nicolas KOWALSKI wrote:


Is it possible to make dovecot's deliver discard duplicate messages?


No, currently not.

BTW: if two copies of a message with the same message-id and the same 
envelope receipient are received.
I know that MessageIDs are supposed to be globally unique, but one cannot 
count on it.


This feature had been asked several times; it should be possible to code 
using the extdata plugin API in newest Sieve, see the last messages in 
the list.


Regards,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBS0ySrb+Vh58GPL/cAQIxzgf/Qw2o2uXxTAruoVCPnj1RQNq4VOWfdqJm
A7AiZmL/YYnwOx3GMJI8R48Fy5s7HzANmj5uibyp/80/tTgvaCSndJ6MxRqFSygd
Gj/nwsg+LHQi2GJJ2T908yrEvpX4Gv6Roy1ZxsheorfM+RYPseAyu6iR3z88AEGX
0VlZagPBdNQ5U+7TJTrLQgpM92W8UUuWAYE4j0CHqEFbLiPyS8dvqhvpVTjdqrtb
ZdKufF9FrSPKoTnrUpiGRECfensbFgxadswYSxsbzA7qIM1FcXfPP0Pnkp0GmBPY
SB+2eCLUG7K5THy9NQHSEfnP3wm1NtRKaHuloQFnswUd/cK8JY3ywg==
=wyop
-END PGP SIGNATURE-

Re: [Dovecot] Discard duplicate messages at delivery?

[Nicolas KOWALSKI]

Steffen Kaiser skdove...@smail.inf.fh-brs.de writes:

 On Tue, 12 Jan 2010, Nicolas KOWALSKI wrote:

 Is it possible to make dovecot's deliver discard duplicate messages?

 No, currently not.

Ok.

 BTW: if two copies of a message with the same message-id and the same 
 envelope receipient are received.
 I know that MessageIDs are supposed to be globally unique, but one cannot 
 count on it.

I agree, but IMHO, most of the times it is ok, and by using a short
lifetime for the Message-IDS stored, the risk of having false
duplicates is even less important.

Thanks for your reply,
-- 
Nicolas

Re: [Dovecot] 1.1.1, mbox_snarf and duplicate messages

[Timo Sirainen]

This should help: http://hg.dovecot.org/dovecot-1.1/rev/7374114ce7a8



signature.asc
Description: This is a digitally signed message part

[Dovecot] 1.1.1, mbox_snarf and duplicate messages

[Laurent . Moineau]

Hello,
I recently switched to dovecot 1.1.1 with mbox_snarf from uw-imap with  
mbox driver enabled.


The mail is delivered by procmail in /var/spool/mail/user
Most of my users have a file INBOX located in $HOME/mail
The mail is transfered from /var/spool/mail/user to $HOME/mail/INBOX  
every time an imap connection is done.


Things are OK with clients like thunderbird or evolution, but with imp  
or mostly squirrelmail messages are duplicated (some user reported  
that a single message duplicated 50 times !).


Every imap connection (thunderbird or webmail) terminates with a warning :

Timeout leak: 0x4534e0

I 've tried to use  fcntl in :
lock_method, mbox_read_locks and mbox_write_locks but things are worse  
than traditional dotlocks.



My config on my first server :

sendmail-8.14.1
procmail
dovecot 1.1.1

On the second server :

The webmail (imp and squirrelmail, latest versions) is installed on  
another server but uses server 1 as imap server.
I 've tried to use an imap proxy (perdition) but without any  
improvement as far as this problem is concerned.
I previously used another dovecot server on that machine with an NFS  
mount to get /var/spool/mail from the first server with the duplicate  
problem too.


I enabled mail_log and there where a bunch of Info messages like this :

dovecot: Jul 11 18:20:11 Info: IMAP(foo): copy: uid=22,  
dest=/users/foo/mail/INBOX,  
msgid=[EMAIL PROTECTED], size=2223


Any hint ?

Is mbox_snarf considered as stable ?

dovecot -n :

# 1.1.1: /etc/dovecot.conf
log_path: /var/log/dovecot.log
protocols: imaps pop3 pop3s
listen: *
ssl_cert_file: /etc/pki/tls/certs/ipop3d.pem
ssl_key_file: /etc/pki/tls/certs/ipop3d.pem
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
mail_privileged_group: mail
mail_gid: 12
mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u
mbox_lazy_writes: no
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_plugins(default): mbox_snarf
mail_plugins(imap): mbox_snarf
mail_plugins(pop3):
mail_plugin_dir(default): /usr/lib64/dovecot/imap
mail_plugin_dir(imap): /usr/lib64/dovecot/imap
mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3
auth default:
  debug: yes
  passdb:
driver: pam
  userdb:
driver: passwd
plugin:
  mbox_snarf: %h/mail/INBOX

/etc/procmailrc :

SENDMAIL=/usr/sbin/sendmail
MAILDIR=/var/spool/mail
SPAM=$HOME/mail/spam
DROPPRIVS=yes
:0 H
*^X-Spam-Status: Yes
$SPAM

:0 H
*^Subject: .**SPAM
$SPAM



Thanks for your help.

Laurent Moineau

System Administrator



This message was sent using IMP, the Internet Messaging Program.

Re: [Dovecot] Duplicate Messages, Different X-UIDs?

[Charles Marcus]

On 2/18/2008, Joe Allesi -X (joallesi - Coyote Creek Consulting at
Cisco) ([EMAIL PROTECTED]) wrote:

Is it a bad IMAP client, or a known bug?


Well, it might help to know what client? ;)

--

Best regards,

Charles

[Dovecot] Duplicate Messages, Different X-UIDs?

[Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco)]

We're running into an issue where sendmail is only receiving one e-mail,
but after a client accesses the message via IMAP and moves it to another
IMAP folder, the message duplicates but each message has different X-UID
headers. Has anyone ever seen this type of anomaly before? Is it a bad
IMAP client, or a known bug?

Running 1.0.7

Thanks!

[Dovecot] convert plugin: endless conversion and duplicate messages

[Andrew Ziem]

Hi,

When an mbox has a filename with a period, the Dovecot 1.0.1 convert 
plugin will endlessly convert the same mbox causing duplicate messages.  
To reproduce, create try converting two mboxes: one with a valid name 
and another with an invalid name.  Then, repeat the login procedure a 
few times.


Dovecot should do something more graceful such as replacing periods with 
another character.


Here's /var/log/mail/errors
Jul  2 08:29:44 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 08:39:46 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 08:48:54 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 08:48:58 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 08:49:39 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 08:59:40 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 09:09:40 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name
Jul  2 09:20:23 aslan dovecot: IMAP(crystalp): Mailbox conversion: 
Couldn't create mailbox Print Shop Misc.: Invalid mailbox name


I didn't test other non-{alphanumeric,whitespace} characters.

Other than this and my previous e-mails, our conversion from UW-IMAP 
mboxes went nicely.  I notice the performance difference, and our users 
will be happy to finally have proper subfolders.



Andrew