Re: Replication issue 2.3.7

2019-07-20 Thread Stuart Henderson via dovecot
On 2019-07-16, Stuart Henderson via dovecot  wrote:
> On 2019/07/16 19:46, Aki Tuomi wrote:
>> 
>> > On 16/07/2019 18:40 Stuart Henderson via dovecot  
>> > wrote:
>> > 
>> >  
>> > On 2019-07-13, Reio Remma via dovecot  wrote:
>> > > Hello!
>> > >
>> > > I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
>> > >
>> > > Jul 13 11:52:10 turin dovecot: doveadm: Error: 
>> > > dsync-remote(r...@mrstuudio.ee): Error: 
>> > > Exporting mailbox INBOX failed: Mailbox attribute 
>> > > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
>> > > attributes not enabled
>> > > Jul 13 11:52:11 turin dovecot: doveadm: Error: 
>> > > dsync-remote(r...@mrstuudio.ee): Error: 
>> > > Exporting mailbox INBOX failed: Mailbox attribute 
>> > > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
>> > > attributes not enabled
>> > 
>> > Same here (in my case: on OpenBSD -current, mdbox, pigeonhole 0.5.7).
>> > I have backed out to 2.3.6 + pigeonhole 0.5.6 and it's happy again.
>> 
>> Instead of downgrading, you could've attempted
>> 
>> mail_attribute_dict = file:%h/dovecot-attributes
>> 
>> to enable mailbox attributes. This should fix sieve script replication too.
>> 
>> Aki
>
> Perhaps, but when dealing with mailboxes out of sync between the two
> replicated machines the first thought is to backout the change that
> triggered the problem, rather than guess things that might help,
> especially when they aren't mentioned in the release notes (actually
> the only thing I find in either NEWS or ChangeLog relating to
> attributes/metadata at all since the last release is adding methods
> to access this via lua API?).
>
>

So after adding "mail_attribute_dict = file:%h/dovecot-attributes"
(alone, I have not configured to use the METADATA extension and the
file is not being created) and going back to 2.3.7, syncs are now
working and I see no more "lookup failed: Mailbox attributes not
enabled".

Prior to adding mail_attribute_dict, with a two server dsync setup,
new mail was syncing from A->B ok but new mail arriving on B didn't
sync to A.

I'm happy that things are now functioning ok on this setup but given
the limited information about what's happening and no information about
config changes needed for 2.3.6->2.3.7 I'm a bit twitchy about 2.3.7
in OS packages (I reverted it to 2.3.6 in OpenBSD after running into
the problem) so it would be nice to know a little more about what's
going on here.



Re: Replication issue 2.3.7

2019-07-16 Thread Stuart Henderson via dovecot
On 2019/07/16 19:46, Aki Tuomi wrote:
> 
> > On 16/07/2019 18:40 Stuart Henderson via dovecot  
> > wrote:
> > 
> >  
> > On 2019-07-13, Reio Remma via dovecot  wrote:
> > > Hello!
> > >
> > > I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
> > >
> > > Jul 13 11:52:10 turin dovecot: doveadm: Error: 
> > > dsync-remote(r...@mrstuudio.ee): Error: 
> > > Exporting mailbox INBOX failed: Mailbox attribute 
> > > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> > > attributes not enabled
> > > Jul 13 11:52:11 turin dovecot: doveadm: Error: 
> > > dsync-remote(r...@mrstuudio.ee): Error: 
> > > Exporting mailbox INBOX failed: Mailbox attribute 
> > > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> > > attributes not enabled
> > 
> > Same here (in my case: on OpenBSD -current, mdbox, pigeonhole 0.5.7).
> > I have backed out to 2.3.6 + pigeonhole 0.5.6 and it's happy again.
> 
> Instead of downgrading, you could've attempted
> 
> mail_attribute_dict = file:%h/dovecot-attributes
> 
> to enable mailbox attributes. This should fix sieve script replication too.
> 
> Aki

Perhaps, but when dealing with mailboxes out of sync between the two
replicated machines the first thought is to backout the change that
triggered the problem, rather than guess things that might help,
especially when they aren't mentioned in the release notes (actually
the only thing I find in either NEWS or ChangeLog relating to
attributes/metadata at all since the last release is adding methods
to access this via lua API?).



Re: Replication issue 2.3.7

2019-07-16 Thread Aki Tuomi via dovecot


> On 16/07/2019 18:40 Stuart Henderson via dovecot  wrote:
> 
>  
> On 2019-07-13, Reio Remma via dovecot  wrote:
> > Hello!
> >
> > I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
> >
> > Jul 13 11:52:10 turin dovecot: doveadm: Error: 
> > dsync-remote(r...@mrstuudio.ee): Error: 
> > Exporting mailbox INBOX failed: Mailbox attribute 
> > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> > attributes not enabled
> > Jul 13 11:52:11 turin dovecot: doveadm: Error: 
> > dsync-remote(r...@mrstuudio.ee): Error: 
> > Exporting mailbox INBOX failed: Mailbox attribute 
> > vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> > attributes not enabled
> 
> Same here (in my case: on OpenBSD -current, mdbox, pigeonhole 0.5.7).
> I have backed out to 2.3.6 + pigeonhole 0.5.6 and it's happy again.

Instead of downgrading, you could've attempted

mail_attribute_dict = file:%h/dovecot-attributes

to enable mailbox attributes. This should fix sieve script replication too.

Aki


Re: Replication issue 2.3.7

2019-07-16 Thread Stuart Henderson via dovecot
On 2019-07-13, Reio Remma via dovecot  wrote:
> Hello!
>
> I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
>
> Jul 13 11:52:10 turin dovecot: doveadm: Error: 
> dsync-remote(r...@mrstuudio.ee): Error: 
> Exporting mailbox INBOX failed: Mailbox attribute 
> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> attributes not enabled
> Jul 13 11:52:11 turin dovecot: doveadm: Error: 
> dsync-remote(r...@mrstuudio.ee): Error: 
> Exporting mailbox INBOX failed: Mailbox attribute 
> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
> attributes not enabled

Same here (in my case: on OpenBSD -current, mdbox, pigeonhole 0.5.7).
I have backed out to 2.3.6 + pigeonhole 0.5.6 and it's happy again.




Re: Replication issue 2.3.7

2019-07-13 Thread Gerald Galster via dovecot
Hello,

this sounds like the replication problem that occured after 2.2.33.2:

https://www.dovecot.nl/list/dovecot/2018-March/111422.html

As far as I remember there is no fix yet.

Best regards
Gerald



> Am 13.07.2019 um 14:18 schrieb Günther J. Niederwimmer via dovecot 
> :
> 
> Hello,
> 
> Thanks for the info and workaround! 
> 
> I found and have the same problems after read your mail :-(.  
> 
> Am Samstag, 13. Juli 2019, 11:13:23 CEST schrieb Reio Remma via dovecot:
>> Hello!
>> 
>> I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
>> 
>> Jul 13 11:52:10 turin dovecot: doveadm: Error:
>> dsync-remote(r...@mrstuudio.ee): Error:
>> Exporting mailbox INBOX failed: Mailbox attribute
>> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox
>> attributes not enabled
>> Jul 13 11:52:11 turin dovecot: doveadm: Error:
>> dsync-remote(r...@mrstuudio.ee): Error:
>> Exporting mailbox INBOX failed: Mailbox attribute
>> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox
>> attributes not enabled
>> 
>> After turning on mailbox attributes these errors went away:
>> 
>> mail_attribute_dict = file:~/Maildir/dovecot-attributes
>> 
>> protocol imap {
>> imap_metadata = yes
>> }
>> 
>> But now the errors are replaced with (when deleting mail):
>> 
>> Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning:
>> /home/vmail/mrstuudio.ee/reio/Maildir/dovecot-uidlist: Duplicate file
>> entry at line 2: 1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262
>> (uid 23030 -> 23031) - retrying by re-reading from beginning
>> Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning: Maildir
>> /home/vmail/mrstuudio.ee/reio/Maildir: Expunged message reappeared,
>> giving a new UID (old uid=23030,
>> file=1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262:2,S)
>> 
>> The mail message reappears on the other side of dsync and eventually I
>> end up with 3 identical messages in trash after I've deleted them on
>> both sides.
>> 
>> Thanks for any advice,
>> Reio
> 
> 
> -- 
> mit freundliche Grüßen / best regards,
> 
>  Günther J. Niederwimmer
> 
> 



Re: Replication issue 2.3.7

2019-07-13 Thread Günther J . Niederwimmer via dovecot
Hello,

Thanks for the info and workaround! 

I found and have the same problems after read your mail :-(.  

Am Samstag, 13. Juli 2019, 11:13:23 CEST schrieb Reio Remma via dovecot:
> Hello!
> 
> I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:
> 
> Jul 13 11:52:10 turin dovecot: doveadm: Error:
> dsync-remote(r...@mrstuudio.ee): Error:
> Exporting mailbox INBOX failed: Mailbox attribute
> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox
> attributes not enabled
> Jul 13 11:52:11 turin dovecot: doveadm: Error:
> dsync-remote(r...@mrstuudio.ee): Error:
> Exporting mailbox INBOX failed: Mailbox attribute
> vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox
> attributes not enabled
> 
> After turning on mailbox attributes these errors went away:
> 
> mail_attribute_dict = file:~/Maildir/dovecot-attributes
> 
> protocol imap {
>  imap_metadata = yes
> }
> 
> But now the errors are replaced with (when deleting mail):
> 
> Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning:
> /home/vmail/mrstuudio.ee/reio/Maildir/dovecot-uidlist: Duplicate file
> entry at line 2: 1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262
> (uid 23030 -> 23031) - retrying by re-reading from beginning
> Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning: Maildir
> /home/vmail/mrstuudio.ee/reio/Maildir: Expunged message reappeared,
> giving a new UID (old uid=23030,
> file=1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262:2,S)
> 
> The mail message reappears on the other side of dsync and eventually I
> end up with 3 identical messages in trash after I've deleted them on
> both sides.
> 
> Thanks for any advice,
> Reio


-- 
mit freundliche Grüßen / best regards,

  Günther J. Niederwimmer




Re: Replication issue 2.3.7

2019-07-13 Thread Reio Remma via dovecot

On 13.07.2019 12:13, Reio Remma via dovecot wrote:

Hello!

I noticed these in the logs since upgrading from 2.3.6. to 2.3.7:

Jul 13 11:52:10 turin dovecot: doveadm: Error: 
dsync-remote(r...@mrstuudio.ee): Error: 
Exporting mailbox INBOX failed: Mailbox attribute 
vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
attributes not enabled
Jul 13 11:52:11 turin dovecot: doveadm: Error: 
dsync-remote(r...@mrstuudio.ee): Error: 
Exporting mailbox INBOX failed: Mailbox attribute 
vendor/vendor.dovecot/pvt/server/sieve/files/MR lookup failed: Mailbox 
attributes not enabled


After turning on mailbox attributes these errors went away:

mail_attribute_dict = file:~/Maildir/dovecot-attributes

protocol imap {
    imap_metadata = yes
}

But now the errors are replaced with (when deleting mail):

Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning: 
/home/vmail/mrstuudio.ee/reio/Maildir/dovecot-uidlist: Duplicate file 
entry at line 2: 
1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262 (uid 23030 -> 
23031) - retrying by re-reading from beginning
Jul 13 12:04:32 turin dovecot: imap(r...@mrstuudio.ee): Warning: 
Maildir /home/vmail/mrstuudio.ee/reio/Maildir: Expunged message 
reappeared, giving a new UID (old uid=23030, 
file=1563008644.M18534P25946.orc.mrstuudio.ee,S=4180,W=4262:2,S)


The mail message reappears on the other side of dsync and eventually I 
end up with 3 identical messages in trash after I've deleted them on 
both sides.


Thanks for any advice,
Reio


More info:

the issue manifests itself when I read a freshly arrived message on one 
server and then delete it on the other server.


If I delete it on the same server after reading, it seems to work.

The mail client is Thunderbird.

Reio