Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

That thread is clarified. Was an issue from a script from Sarenet…. It has been 
hard to find (as described in the new thread) but Cyrus was just fine.



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 10 jul 2019, a las 10:03, Egoitz Aurrekoetxea  escribió:
> 
> The subject of this email is not properly set… it should be . Issues in 
> replication with folder subscription and Sieve
> 
> As I think I discovered something I reopen a new thread with the title 
> properly
> 
>  
> 
> 
> 
> Egoitz Aurrekoetxea
> Dpto. de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es 
> www.sarenet.es 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
> 
>> El 10 jul 2019, a las 9:22, Albert Shih > > escribió:
>> 
>> Le 09/07/2019 à 22:49:01+0200, Egoitz Aurrekoetxea a écrit
>>> By the way, for your case I would recommend doing a script that does a get 
>>> from
>>> dovecot and a put to Cyrus instead of copying Sieve files directly… it’s a 
>>> much
>>> more cleaner way…
>> 
>> Yes, it is what I did, before I try de sync I event do a
>> /usr/local/cyrsus/sievec on each file to by absolute sure the sieve file
>> compile correctly
>> 
>> Regards.
>> 
>> 
>> --
>> Albert SHIH
>> DIO bâtiment 15
>> Observatoire de Paris
>> xmpp: j...@obspm.fr 
>> Heure local/Local time:
>> Wed 10 Jul 2019 09:20:09 AM CEST
> 
> 
> Cyrus Home Page: http://www.cyrusimap.org/ 
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
> 
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 
> 

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

It would be better to just talk daemons IMHO…. That should work… but sometimes… 
perhaps another things could be implied… so… the most clear way, should be to 
just put as a normal client with a expect script for instance all the source 
scripts to Cyrus… but using sieveshell… and not using files directly (not 
copying) anything to Cyrus partitions “by hand”…

As said IMHO…

Cheers!



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 10 jul 2019, a las 9:22, Albert Shih  escribió:
> 
> Le 09/07/2019 à 22:49:01+0200, Egoitz Aurrekoetxea a écrit
>> By the way, for your case I would recommend doing a script that does a get 
>> from
>> dovecot and a put to Cyrus instead of copying Sieve files directly… it’s a 
>> much
>> more cleaner way…
> 
> Yes, it is what I did, before I try de sync I event do a
> /usr/local/cyrsus/sievec on each file to by absolute sure the sieve file
> compile correctly
> 
> Regards.
> 
> 
> --
> Albert SHIH
> DIO bâtiment 15
> Observatoire de Paris
> xmpp: j...@obspm.fr
> Heure local/Local time:
> Wed 10 Jul 2019 09:20:09 AM CEST


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

The subject of this email is not properly set… it should be . Issues in 
replication with folder subscription and Sieve

As I think I discovered something I reopen a new thread with the title properly

 



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 10 jul 2019, a las 9:22, Albert Shih  escribió:
> 
> Le 09/07/2019 à 22:49:01+0200, Egoitz Aurrekoetxea a écrit
>> By the way, for your case I would recommend doing a script that does a get 
>> from
>> dovecot and a put to Cyrus instead of copying Sieve files directly… it’s a 
>> much
>> more cleaner way…
> 
> Yes, it is what I did, before I try de sync I event do a
> /usr/local/cyrsus/sievec on each file to by absolute sure the sieve file
> compile correctly
> 
> Regards.
> 
> 
> --
> Albert SHIH
> DIO bâtiment 15
> Observatoire de Paris
> xmpp: j...@obspm.fr
> Heure local/Local time:
> Wed 10 Jul 2019 09:20:09 AM CEST


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Albert Shih]

Le 09/07/2019 à 22:49:01+0200, Egoitz Aurrekoetxea a écrit
> By the way, for your case I would recommend doing a script that does a get 
> from
> dovecot and a put to Cyrus instead of copying Sieve files directly… it’s a 
> much
> more cleaner way…

Yes, it is what I did, before I try de sync I event do a
/usr/local/cyrsus/sievec on each file to by absolute sure the sieve file
compile correctly

Regards.


--
Albert SHIH
DIO bâtiment 15
Observatoire de Paris
xmpp: j...@obspm.fr
Heure local/Local time:
Wed 10 Jul 2019 09:20:09 AM CEST

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Albert Shih]

Le 09/07/2019 à 22:44:19+0200, Egoitz Aurrekoetxea a écrit
Hi,

>
> If instead of -A you used -u for each of your users did it worked? Or did it

If I remember correctly (but I not sure) this is how I find out the
problem.

  Try time -A, notice it crash,

so try -u first_user, notice it work

  try again -A, notice it crash again (second user)

try -u second_user, notice it work,

  try -A, notice it crash but for the nth>>1 user

try -u (n+1)th user notice it work

  try to find the difference between nth user who crash and the (n-1)th
  user who work, find out the only difference is the presence of sieve

  Try the infinite loop with -A.

So in fact I never really try the -u with a non working user.


> crashed in the same user as with -A?. Which Cyrus version were you running?.

Don't sure but something like 3.0.4 (or 3.0.5)

--
Albert SHIH
DIO bâtiment 15
Observatoire de Paris
France
xmpp: j...@obspm.fr
Heure local/Local time:
Wed 10 Jul 2019 09:14:51 AM CEST

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

By the way, for your case I would recommend doing a script that does a get from 
dovecot and a put to Cyrus instead of copying Sieve files directly… it’s a much 
more cleaner way…

Cheers!



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 9 jul 2019, a las 22:44, Egoitz Aurrekoetxea  escribió:
> 
> Hi Albert,
> 
> If instead of -A you used -u for each of your users did it worked? Or did it 
> crashed in the same user as with -A?. Which Cyrus version were you running?. 
> 
> Cheers,
> 
> 
> 
> Egoitz Aurrekoetxea
> Dpto. de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es 
> www.sarenet.es 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
> 
>> El 9 jul 2019, a las 15:03, Albert Shih > > escribió:
>> 
>> Le 09/07/2019 à 14:10:49+0200, Egoitz Aurrekoetxea a écrit
>>> Good morning,
>>> 
>>> 
>>> After we upgraded to Cyrus 3.0.8, we saw that some users in the replicas 
>>> didn't
>>> have some folders (or all) subscribed the same way they had in previous env 
>>> in
>>> Cyrus 2.3. Same happened for some users with Sieve scripts. It seemed the
>>> content itself was perfectly copied. It was like, if the copy between 
>>> versions
>>> would not had fully succeed. We fixed it easily by creating some scripts for
>>> checking folder subscriptions and Sieve scripts existence. We though it 
>>> could
>>> perhaps had something to do with some issue replicating folders 
>>> subscriptions
>>> and sieve scripts from 2.3 to 3.0.8. After that, as we fixed it easily and 
>>> was
>>> nothing related to content, we just didn’t go in deep in this topic.
>> 
>> After my transfering all mail from my old server (dovecot) to the new one 
>> (under
>> cyrus), I try to initialize the sync, so I launch the synchronization, and
>> find out everytime the user got a sieve, the sync processus crash, 
>> butevent the
>> it crash it still create « something », so the next time I launch the sync
>> it pass (and email a actually synchronize). So for the first synchro I
>> juste launch a infinite loop in bash to synchronize all user.
>> 
>> I known it's not a very satisfying method but it work.
>> 
>> With new user I don't have any problem.
>> 
>> I already send a email here but don't get any solution
>> 
>>https://lists.andrew.cmu.edu/pipermail/info-cyrus/2018-May/040186.html 
>> 
>> 
>> Don't know if that help
>> 
>> Regards
>> --
>> Albert SHIH
>> DIO bâtiment 15
>> Observatoire de Paris
>> 5 Place Jules Janssen
>> 92195 Meudon Cedex
>> France
>> xmpp: j...@obspm.fr 
>> Heure local/Local time:
>> Tue 09 Jul 2019 02:57:46 PM CEST
>> 
>> Cyrus Home Page: http://www.cyrusimap.org/ 
>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
>> 
>> To Unsubscribe:
>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 
>> 

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

Hi Albert,

If instead of -A you used -u for each of your users did it worked? Or did it 
crashed in the same user as with -A?. Which Cyrus version were you running?. 

Cheers,



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 9 jul 2019, a las 15:03, Albert Shih  escribió:
> 
> Le 09/07/2019 à 14:10:49+0200, Egoitz Aurrekoetxea a écrit
>> Good morning,
>> 
>> 
>> After we upgraded to Cyrus 3.0.8, we saw that some users in the replicas 
>> didn't
>> have some folders (or all) subscribed the same way they had in previous env 
>> in
>> Cyrus 2.3. Same happened for some users with Sieve scripts. It seemed the
>> content itself was perfectly copied. It was like, if the copy between 
>> versions
>> would not had fully succeed. We fixed it easily by creating some scripts for
>> checking folder subscriptions and Sieve scripts existence. We though it could
>> perhaps had something to do with some issue replicating folders subscriptions
>> and sieve scripts from 2.3 to 3.0.8. After that, as we fixed it easily and 
>> was
>> nothing related to content, we just didn’t go in deep in this topic.
> 
> After my transfering all mail from my old server (dovecot) to the new one 
> (under
> cyrus), I try to initialize the sync, so I launch the synchronization, and
> find out everytime the user got a sieve, the sync processus crash, 
> butevent the
> it crash it still create « something », so the next time I launch the sync
> it pass (and email a actually synchronize). So for the first synchro I
> juste launch a infinite loop in bash to synchronize all user.
> 
> I known it's not a very satisfying method but it work.
> 
> With new user I don't have any problem.
> 
> I already send a email here but don't get any solution
> 
>https://lists.andrew.cmu.edu/pipermail/info-cyrus/2018-May/040186.html
> 
> Don't know if that help
> 
> Regards
> --
> Albert SHIH
> DIO bâtiment 15
> Observatoire de Paris
> 5 Place Jules Janssen
> 92195 Meudon Cedex
> France
> xmpp: j...@obspm.fr
> Heure local/Local time:
> Tue 09 Jul 2019 02:57:46 PM CEST
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Albert Shih]

Le 09/07/2019 à 14:10:49+0200, Egoitz Aurrekoetxea a écrit
> Good morning,
>
>
> After we upgraded to Cyrus 3.0.8, we saw that some users in the replicas 
> didn't
> have some folders (or all) subscribed the same way they had in previous env in
> Cyrus 2.3. Same happened for some users with Sieve scripts. It seemed the
> content itself was perfectly copied. It was like, if the copy between versions
> would not had fully succeed. We fixed it easily by creating some scripts for
> checking folder subscriptions and Sieve scripts existence. We though it could
> perhaps had something to do with some issue replicating folders subscriptions
> and sieve scripts from 2.3 to 3.0.8. After that, as we fixed it easily and was
> nothing related to content, we just didn’t go in deep in this topic.

After my transfering all mail from my old server (dovecot) to the new one (under
cyrus), I try to initialize the sync, so I launch the synchronization, and
find out everytime the user got a sieve, the sync processus crash, butevent 
the
it crash it still create « something », so the next time I launch the sync
it pass (and email a actually synchronize). So for the first synchro I
juste launch a infinite loop in bash to synchronize all user.

I known it's not a very satisfying method but it work.

With new user I don't have any problem.

I already send a email here but don't get any solution

https://lists.andrew.cmu.edu/pipermail/info-cyrus/2018-May/040186.html

Don't know if that help

Regards
--
Albert SHIH
DIO bâtiment 15
Observatoire de Paris
5 Place Jules Janssen
92195 Meudon Cedex
France
xmpp: j...@obspm.fr
Heure local/Local time:
Tue 09 Jul 2019 02:57:46 PM CEST

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Issues with replication and folder/Sieve subscription

[Egoitz Aurrekoetxea]

Could perhaps, some of this something to do, with having intermediate folders 
subscribed/unsubscribed in the middle of the tree? And that to cause something 
like it that perhaps is not caused when the mailbox is being accessed by the 
user instead of being replicated (when the change is applied by 
synchronization)?.



Egoitz Aurrekoetxea
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
ego...@sarenet.es 
www.sarenet.es 
Antes de imprimir este correo electrónico piense si es necesario hacerlo.

> El 9 jul 2019, a las 14:10, Egoitz Aurrekoetxea  escribió:
> 
> Good morning,
> 
> 
> After we upgraded to Cyrus 3.0.8, we saw that some users in the replicas 
> didn't have some folders (or all) subscribed the same way they had in 
> previous env in Cyrus 2.3. Same happened for some users with Sieve scripts. 
> It seemed the content itself was perfectly copied. It was like, if the copy 
> between versions would not had fully succeed. We fixed it easily by creating 
> some scripts for checking folder subscriptions and Sieve scripts existence. 
> We though it could perhaps had something to do with some issue replicating 
> folders subscriptions and sieve scripts from 2.3 to 3.0.8. After that, as we 
> fixed it easily and was nothing related to content, we just didn’t go in deep 
> in this topic.
> 
> When we started running couples of servers in Cyrus 3.0.8 (upgraded and 
> apparently with all the change process finished) we have seen in some cases 
> that folder subscription was not properly replicated again. Both members of 
> the couple of servers where running same Cyrus version, the 3.0.8 and this 
> issue, was not seen in all users… just in some of them… Due to this reason I 
> have started checking the git repo logs… for trying to see some perhaps 
> related change or similar… some commit that could very clearly affect to this 
> issue (that could have caused it). I have had no success.
> 
> So after that, and after not being able to reproduce it, have taken a look at 
> the code. By the nature of the things seen, I supposed that perhaps a META 
> operation failed could be involved. I say it because in sync_do_meta() I can 
> read : 
> 
> r = sync_response_parse(sync_be->in, "META", NULL,
> replica_subs, replica_sieve, replica_seen, NULL);
> if (!r) r = sync_do_user_seen(userid, replica_seen, sync_be, flags);
> if (!r) r = sync_do_user_sub(userid, replica_subs, sync_be, flags);
> if (!r) r = sync_do_user_sieve(userid, replica_sieve, sync_be, flags);
> 
> Have been looking for some hours around it but have not been able to see 
> nothing strange… nothing that could have caused this...
> 
> Have you ever heard about this issue?.
> 
> 
> Best regards,
> 
> 
> 
> Egoitz Aurrekoetxea
> Dpto. de sistemas
> 944 209 470
> Parque Tecnológico. Edificio 103
> 48170 Zamudio (Bizkaia)
> ego...@sarenet.es 
> www.sarenet.es 
> Antes de imprimir este correo electrónico piense si es necesario hacerlo.
> 
> 
> Cyrus Home Page: http://www.cyrusimap.org/ 
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 
> 
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus 
> 

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus