Hello Alan, thank you very much for your help. You were right about the version issue. I hadn't realized that I wasn't running the latest version of dovecot. Now the dsync migration of my mails was successful.
Thanks again for your assistance. Helge Am 22.09.2014 um 15:21 schrieb Alan McGinlay: > On 2014-09-22 13:01, Helge Kraak wrote: >> No one? >> Am 19.09.2014 um 00:57 schrieb Helge Kraak: >> Hello, >> I'm aware of these two threads >> http://www.dovecot.org/pipermail/dovecot/2012-March/thread.html#134311 >> http://dovecot.org/pipermail/dovecot/2012-June/thread.html#136488 >> but unfortunately I wasn't successful with my dsync mailbox migration >> attempt despite the information I could find there. I'm using iRedMail setup >> for the dovecot server. I made sure that the dovecot mailbox for the mail >> import had been freshly created and untouched before I tried to run the >> following command. >> Running this command: >> sudo doveadm -vvv -o imapc_host=xxx.de -o imapc_user=username -o >> imapc_password=password -o mail_fsync=never -o mail_prefetch_count=20 -o >> imapc_features=rfc822.size -o imapc_features=fetch-headers -o imapc_port=993 >> -o imapc_ssl=imaps -o imapc_ssl_ca_dir=/etc/ssl -o imapc_ssl_verify=no -o >> imapc_features=rfc822.size -o mailbox_list_index=no -D backup -R -u >> [email protected] imapc: >> I get the following output (I took out some lines obviously not relevant): >> doveadm(root): Debug: Loading modules from directory: >> /usr/lib/dovecot/modules >> doveadm(root): Debug: Module loaded: >> /usr/lib/dovecot/modules/lib10_quota_plugin.so >> doveadm(root): Debug: Loading modules from directory: >> /usr/lib/dovecot/modules/doveadm >> doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() >> failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: >> undefined symbol: acl_user_module (this is usually intentional, so just >> ignore this message) >> doveadm(root): Debug: Skipping module doveadm_expire_plugin, because >> dlopen() failed: >> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined >> symbol: expire_set_deinit (this is usually intentional, so just ignore this >> message) >> doveadm(root): Debug: Module loaded: >> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so >> doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() >> failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: >> undefined symbol: i_stream_create_deflate (this is usually intentional, so >> just ignore this message) >> doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() >> failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: >> undefined symbol: fts_backend_rescan (this is usually intentional, so just >> ignore this message) >> doveadm([email protected]): Debug: Added userdb setting: >> plugin/[email protected] >> doveadm([email protected]): Debug: Added userdb setting: >> plugin/quota_rule=*:bytes=41943040000 >> doveadm([email protected]): Debug: Effective uid=2000, gid=2000, >> home=/var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59/ >> doveadm([email protected]): Debug: Namespace : type=private, prefix=, >> sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes >> location=maildir://var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir/:INDEX=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir/ >> doveadm([email protected]): Debug: maildir++: >> root=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir, >> index=, control=, >> inbox=//var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir, >> alt= >> doveadm([email protected]): Debug: Namespace : type=shared, >> prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, >> subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u >> doveadm([email protected]): Debug: shared: root=/var/run/dovecot, index=, >> control=, inbox=, alt= >> dsync([email protected]): Debug: Namespace : type=private, prefix=, sep=/, >> inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: >> dsync([email protected]): Debug: imapc: root=, index=, control=, inbox=, >> alt= >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Looking up IP >> address >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Connecting to >> 78.138.89.136:993 >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Starting SSL >> handshake >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Server >> capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> AUTH=PLAIN AUTH=LOGIN >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Authenticating as >> username >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Server >> capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT >> SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE >> CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC >> ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Authenticated >> successfully >> dsync([email protected]): Debug: Namespace : type=shared, >> prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, >> subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u >> dsync([email protected]): Debug: shared: root=/var/run/dovecot, index=, >> control=, inbox=, alt= >> dsync([email protected]): Debug: Namespace : Using permissions from >> //var/vmail/vmail1/domain.com/m/i/c/michael-2014.09.03.14.32.59//Maildir: >> mode=0700 gid=-1 >> dsync([email protected]): Error: Can't delete mailbox INBOX: INBOX can't be >> deleted. >> dsync([email protected]): Info: Amazon: uidnext changed: 1056 != 1 >> dsync([email protected]): Info: INBOX: only in dest >> (guid=3c68c835800a07547d45000029cbe4c2)= 1 >> dsync([email protected]): Info: Deleted Messages: uidnext changed: 109 != 1 >> dsync([email protected]): Info: MBA Mails: uidnext changed: 444 != 1 >> dsync([email protected]): Info: Archive: highest_modseq changed: 0 != 1 >> dsync([email protected]): Info: Spam: uidnext changed: 3 != 1 >> dsync([email protected]): Info: Apple Mail To Do: highest_modseq changed: 0 >> != 1 >> dsync([email protected]): Info: Jobsuche: uidnext changed: 22436 != 1 >> dsync([email protected]): Info: Trash (Messages): uidnext changed: 697 != 1 >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Looking up IP >> address >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Connecting to >> IP-Adress:993 >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Starting SSL >> handshake >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Server >> capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> AUTH=PLAIN AUTH=LOGIN >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Authenticating as >> username >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Server >> capabilities: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT >> SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE >> CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC >> ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Authenticated >> successfully >> dsync([email protected]): Error: Trying to open a non-listed mailbox with >> guid=3c68c835800a07547d45000029cbe4c2 >> dsync([email protected]): Error: msg iteration failed: Couldn't open >> mailbox 3c68c835800a07547d45000029cbe4c2 >> dsync([email protected]): Error: Trying to open a non-listed mailbox with >> guid=3c68c835800a07547d45000029cbe4c2 >> dsync([email protected]): Debug: imapc(s04.xxx.de:993): Disconnected >> sudo dovecot -n >> # 2.1.7: /etc/dovecot/dovecot.conf >> # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 >> auth_master_user_separator = * >> auth_mechanisms = PLAIN LOGIN >> dict { >> acl = mysql:/etc/dovecot/dovecot-share-folder.conf >> quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf >> } >> first_valid_uid = 2000 >> last_valid_uid = 2000 >> listen = * >> log_path = /var/log/dovecot.log >> mail_gid = 2000 >> mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ >> mail_plugins = quota >> mail_uid = 2000 >> managesieve_notify_capability = mailto >> managesieve_sieve_capability = fileinto reject envelope encoded-character >> vacation subaddress comparator-i;ascii-numeric relational regex imap4flags >> copy include variables body enotify environment mailbox date ihave >> namespace { >> inbox = yes >> location = >> mailbox Drafts { >> auto = subscribe >> special_use = \Drafts >> } >> mailbox Junk { >> auto = subscribe >> special_use = \Junk >> } >> mailbox Sent { >> auto = subscribe >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> auto = no >> special_use = \Sent >> } >> mailbox Spam { >> auto = no >> special_use = \Junk >> } >> mailbox Trash { >> auto = subscribe >> special_use = \Trash >> } >> prefix = >> separator = / >> type = private >> } >> namespace { >> list = children >> location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u >> prefix = Shared/%%u/ >> separator = / >> subscriptions = yes >> type = shared >> } >> passdb { >> args = /etc/dovecot/dovecot-mysql.conf >> driver = sql >> } >> passdb { >> args = /etc/dovecot/dovecot-master-users-password >> driver = passwd-file >> master = yes >> } >> plugin { >> acl = vfile >> acl_shared_dict = proxy::acl >> auth_socket_path = /var/run/dovecot/auth-master >> quota = dict:user::proxy::quotadict >> quota_rule = *:storage=1G >> quota_warning = storage=85%% quota-warning 85 %u >> quota_warning2 = storage=90%% quota-warning 90 %u >> quota_warning3 = storage=95%% quota-warning 95 %u >> sieve = /%Lh/sieve/dovecot.sieve >> sieve_default = /var/vmail/sieve/dovecot.sieve >> sieve_dir = /%Lh/sieve >> sieve_global_dir = /var/vmail/sieve >> } >> protocols = pop3 imap sieve lmtp >> service auth { >> unix_listener /var/spool/postfix/private/dovecot-auth { >> group = postfix >> mode = 0666 >> user = postfix >> } >> unix_listener auth-master { >> group = vmail >> mode = 0666 >> user = vmail >> } >> unix_listener auth-userdb { >> group = vmail >> mode = 0660 >> user = vmail >> } >> } >> service dict { >> unix_listener dict { >> group = vmail >> mode = 0660 >> user = vmail >> } >> } >> service imap-login { >> process_limit = 500 >> service_count = 1 >> } >> service lmtp { >> executable = lmtp -L >> inet_listener lmtp { >> port = 24 >> } >> process_min_avail = 5 >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = postfix >> mode = 0600 >> user = postfix >> } >> user = vmail >> } >> service pop3-login { >> service_count = 1 >> } >> service quota-warning { >> executable = script /usr/local/bin/dovecot-quota-warning.sh >> unix_listener quota-warning { >> group = vmail >> mode = 0660 >> user = vmail >> } >> } >> ssl = required >> ssl_cert = </etc/ssl/certs/iRedMail_CA.pem >> ssl_key = </etc/ssl/private/iRedMail.key >> userdb { >> args = /etc/dovecot/dovecot-mysql.conf >> driver = sql >> } >> protocol lda { >> auth_socket_path = /var/run/dovecot/auth-master >> lda_mailbox_autocreate = yes >> log_path = /var/log/dovecot-sieve.log >> mail_plugins = quota sieve >> postmaster_address = root >> } >> protocol lmtp { >> info_log_path = /var/log/dovecot-lmtp.log >> lmtp_save_to_detail_mailbox = yes >> mail_plugins = quota sieve >> postmaster_address = postmaster >> recipient_delimiter = + >> } >> protocol imap { >> imap_client_workarounds = tb-extra-mailbox-sep >> mail_plugins = quota imap_quota >> } >> protocol pop3 { >> mail_plugins = quota >> pop3_client_workarounds = outlook-no-nuls oe-ns-eoh >> pop3_uidl_format = %08Xu%08Xv >> } >> Any assistance is highly appreciated. Thank you. >> Helge > > I seem to remember having similar issues with dsync on that dovecot version. > I am not 100% sure as it was a while ago now. > > Currently using very similar settings to migrate from a cyrus box on solaris > 10 and dsync works well. I use Dovecot 2.2.13 from the following ubuntu ppa: > > https://launchpad.net/~bigmichi1/+archive/ubuntu/dovecot > > (the ppa owner is on this list I think) > > There have been a lot of fixes to dsync since 2.2.7 so it might be worth > upgrading. > > /A
