Re: Cyrus replication problems
On Tue, 11 Sep 2007 23:33:02 +0600, Sergey N. Romanov [EMAIL PROTECTED] said: Hello all, I have 2 servers and try to make replication between them. I have FreeBSD 6.2 and Cyrus IMAPd 2.3.9 compiled from sources. Configuration of master server. syncclientcmd=/usr/local/cyrus/bin/sync_client -r 1. I can not start master server if replica server is not started. I have messages like 18:12:50 [b3] sync_client[54464]: connect(xx.xx.xx.xx) failed: Operation timed out in master server log file. Try: /usr/local/cyrus/bin/sync_client -r -o -o Only attempt to connect to the backend server once rather than waiting up to 1000 seconds before giving up. I wrote this patch after having exactly the same problem, and it was accepted upstream pre 2.3.9, so you shouldn't need any patches for it. 2. If I restarted replica server, then I have problems with replication. Right after replica stopped I have 18:34:05 [b3] sync_client[76096]: Error in do_sync(): bailing out! message in master server log file and I can not see sync_client process on master server. Yes. We have a script which runs from cron every 10 minutes and watches for this situation. I believe I've posted to this list about it before: [EMAIL PROTECTED] http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=42833 3. After replica server is started again replication do not start (because no sync_client process) and I should restart master server. Yes, or start sync_client by hand. 4. I can see files like log- in sync folder and commands in these files are not executed. sync_client do not process these files after replication started. You need to run them by hand too: sync_client -r -f /path/to/sync/log- rm -f /path/to/sync/log- Replication do not work correctly? Or what is wrong?! Replication is not a turnkey solution - you need to have monitoring in place and tools to help you clean up. As you can see, it's something that was built to fill a particular need in one place and hasn't really been generalised out to a fault-tolerant tool that can be used without significant effort into maintaining it. That said, once you have that infrastructure around it, it works pretty well most of the time. Be glad you didn't live through the really buggy early days! Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus replication problems
Hello all,
I have 2 servers and try to make replication between them.
I have FreeBSD 6.2 and Cyrus IMAPd 2.3.9 compiled from sources.
Configuration of master server.
imapd.conf :
...
sync_machineid: 1
sync_host: xx.xx.xx.xx
sync_authname: x
sync_password: x
sync_log: 1
cyrus.conf:
START {
...
syncclientcmd=/usr/local/cyrus/bin/sync_client -r
}
UUIDs for messages are enabled.
Configuration of replica server.
cyrus.conf:
SERVICES {
...
syncservercmd=/usr/local/cyrus/bin/sync_server listen=csync
}
Replication work, but I have some problems:
1. I can not start master server if replica server is not started. I
have messages like
18:12:50 [b3] sync_client[54464]: connect(xx.xx.xx.xx) failed: Operation
timed out
in master server log file.
2. If I restarted replica server, then I have problems with replication.
Right after replica stopped I have
18:34:05 [b3] sync_client[76096]: Error in do_sync(): bailing out!
message in master server log file and I can not see sync_client process
on master server.
3. After replica server is started again replication do not start
(because no sync_client process) and I should restart master server.
4. I can see files like log- in sync folder and commands in these
files are not executed. sync_client do not process these files after
replication started.
Replication do not work correctly? Or what is wrong?!
--
Best regards,
Sergey N. Romanov
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus replication problems
Hy all again! I get more information. In copying from my slave 2.3.8 the sync_client and sync_server files to the master in 2.3.7 I am now able to run sync_client -v -m user.toto2 on my master it works! I think there is an incompatibility between the two modules but i'm absolutely unable to read and understand any codes. Now seems to work fine, also when i do a rolling sync! -- Debut du message initial --- De : [EMAIL PROTECTED] A : dkirhlarov [EMAIL PROTECTED] Copies : info-cyrus info-cyrus@lists.andrew.cmu.edu Date : Thu, 1 Mar 2007 17:39:36 +0100 Objet : Re: Cyrus replication problems Does someone can help me with it? It seems replication is rely hard to get working? Thanks! I remove the line syncserver cmd=/usr/cyrus/bin/sync_server listen=csync from my cyrus.conf then i try to sync manually, it doesn't sync anything. If i make as cyrus a sync_client -u -v i will see on the replica : Imapreplica syncserver[1185]: login: [10.1.45.3] cyrus DIGEST-MD5 User logged in So it seems to talk between my two servers. But nothing is synchronize ... But on my master, i get nothing on the var/log/messages ... Sometimes and i do not know how, i get on the master : Feb 27 17:58:02 imaptest sync_client[1109]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:02 imaptest sync_client[1109]: Error in do_mailboxes(): bailing out! Feb 27 17:58:16 imaptest sync_client[]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:16 imaptest sync_client[]: Error in do_mailboxes(): bailing out! Feb 27 17:58:22 imaptest sync_client[1112]: CREATE received BAD response: Missing required argument to Create Feb 27 17:58:22 imaptest sync_client[1112]: Error in do_mailboxes(): bailing out! I can't reproduce it everytimes... What i would like to do is to synchronize the master on the replica to use the replica as a backup server not High availability. So do i need to make rolling (as i understood, i think no! ?) Do i must put parameters at sync_client -u -v or can it sync every users and mailboxes (with -m) automatically? Can someone helps me please? Thanks a lot! -- Debut du message initial --- De : [EMAIL PROTECTED] A : info-cyrus@lists.andrew.cmu.edu Copies : Date : Mon, 26 Feb 2007 19:25:07 +0300 Objet : Re: Cyrus replication problems On Mon, Feb 26, 2007 at 02:35:05PM +0100, [EMAIL PROTECTED] wrote: I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=41779 You must start sync_client over different script AFTER starting cyrus imapd server. WBR -- Dmitriy Kirhlarov OILspace, 26 Leninskaya sloboda, bld. 2, 2nd floor, 115280 Moscow, Russia P:+7 495 105 7245 ext.208 F:+7 495 105 7246 E:[EMAIL PROTECTED] Building Successful Supply Chains - One Solution At A Time. www.oilspace.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus replication problems
Hy all again! I get more information. In copying from my slave 2.3.8 the sync_client and sync_server files to the master in 2.3.7 I am now able to run sync_client -v -m user.toto2 on my master it works! I think there is an incompatibility between the two modules but i'm absolutely unable to read and understand any codes. Now seems to work fine, also when i do a rolling sync! -- Debut du message initial --- De : [EMAIL PROTECTED] A : dkirhlarov [EMAIL PROTECTED] Copies : info-cyrus info-cyrus@lists.andrew.cmu.edu Date : Thu, 1 Mar 2007 17:39:36 +0100 Objet : Re: Cyrus replication problems Does someone can help me with it? It seems replication is rely hard to get working? Thanks! I remove the line syncserver cmd=/usr/cyrus/bin/sync_server listen=csync from my cyrus.conf then i try to sync manually, it doesn't sync anything. If i make as cyrus a sync_client -u -v i will see on the replica : Imapreplica syncserver[1185]: login: [10.1.45.3] cyrus DIGEST-MD5 User logged in So it seems to talk between my two servers. But nothing is synchronize ... But on my master, i get nothing on the var/log/messages ... Sometimes and i do not know how, i get on the master : Feb 27 17:58:02 imaptest sync_client[1109]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:02 imaptest sync_client[1109]: Error in do_mailboxes(): bailing out! Feb 27 17:58:16 imaptest sync_client[]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:16 imaptest sync_client[]: Error in do_mailboxes(): bailing out! Feb 27 17:58:22 imaptest sync_client[1112]: CREATE received BAD response: Missing required argument to Create Feb 27 17:58:22 imaptest sync_client[1112]: Error in do_mailboxes(): bailing out! I can't reproduce it everytimes... What i would like to do is to synchronize the master on the replica to use the replica as a backup server not High availability. So do i need to make rolling (as i understood, i think no! ?) Do i must put parameters at sync_client -u -v or can it sync every users and mailboxes (with -m) automatically? Can someone helps me please? Thanks a lot! -- Debut du message initial --- De : [EMAIL PROTECTED] A : info-cyrus@lists.andrew.cmu.edu Copies : Date : Mon, 26 Feb 2007 19:25:07 +0300 Objet : Re: Cyrus replication problems On Mon, Feb 26, 2007 at 02:35:05PM +0100, [EMAIL PROTECTED] wrote: I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=41779 You must start sync_client over different script AFTER starting cyrus imapd server. WBR -- Dmitriy Kirhlarov OILspace, 26 Leninskaya sloboda, bld. 2, 2nd floor, 115280 Moscow, Russia P:+7 495 105 7245 ext.208 F:+7 495 105 7246 E:[EMAIL PROTECTED] Building Successful Supply Chains - One Solution At A Time. www.oilspace.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus replication problems
Does someone can help me with it? It seems replication is rely hard to get working? Thanks! I remove the line syncserver cmd=/usr/cyrus/bin/sync_server listen=csync from my cyrus.conf then i try to sync manually, it doesn't sync anything. If i make as cyrus a sync_client -u -v i will see on the replica : Imapreplica syncserver[1185]: login: [10.1.45.3] cyrus DIGEST-MD5 User logged in So it seems to talk between my two servers. But nothing is synchronize ... But on my master, i get nothing on the var/log/messages ... Sometimes and i do not know how, i get on the master : Feb 27 17:58:02 imaptest sync_client[1109]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:02 imaptest sync_client[1109]: Error in do_mailboxes(): bailing out! Feb 27 17:58:16 imaptest sync_client[]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:16 imaptest sync_client[]: Error in do_mailboxes(): bailing out! Feb 27 17:58:22 imaptest sync_client[1112]: CREATE received BAD response: Missing required argument to Create Feb 27 17:58:22 imaptest sync_client[1112]: Error in do_mailboxes(): bailing out! I can't reproduce it everytimes... What i would like to do is to synchronize the master on the replica to use the replica as a backup server not High availability. So do i need to make rolling (as i understood, i think no! ?) Do i must put parameters at sync_client -u -v or can it sync every users and mailboxes (with -m) automatically? Can someone helps me please? Thanks a lot! -- Debut du message initial --- De : [EMAIL PROTECTED] A : info-cyrus@lists.andrew.cmu.edu Copies : Date : Mon, 26 Feb 2007 19:25:07 +0300 Objet : Re: Cyrus replication problems On Mon, Feb 26, 2007 at 02:35:05PM +0100, [EMAIL PROTECTED] wrote: I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=41779 You must start sync_client over different script AFTER starting cyrus imapd server. WBR -- Dmitriy Kirhlarov OILspace, 26 Leninskaya sloboda, bld. 2, 2nd floor, 115280 Moscow, Russia P:+7 495 105 7245 ext.208 F:+7 495 105 7246 E:[EMAIL PROTECTED] Building Successful Supply Chains - One Solution At A Time. www.oilspace.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus replication problems
Thanks! I remove the line syncserver cmd=/usr/cyrus/bin/sync_server listen=csync from my cyrus.conf then i try to sync manually, it doesn't sync anything. If i make as cyrus a sync_client -u -v i will see on the replica : Imapreplica syncserver[1185]: login: [10.1.45.3] cyrus DIGEST-MD5 User logged in So it seems to talk between my two servers. But nothing is synchronize ... But on my master, i get nothing on the var/log/messages ... Sometimes and i do not know how, i get on the master : Feb 27 17:58:02 imaptest sync_client[1109]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:02 imaptest sync_client[1109]: Error in do_mailboxes(): bailing out! Feb 27 17:58:16 imaptest sync_client[]: MAILBOXES received BAD response: Missing required argument to Mailboxes Feb 27 17:58:16 imaptest sync_client[]: Error in do_mailboxes(): bailing out! Feb 27 17:58:22 imaptest sync_client[1112]: CREATE received BAD response: Missing required argument to Create Feb 27 17:58:22 imaptest sync_client[1112]: Error in do_mailboxes(): bailing out! I can't reproduce it everytimes... What i would like to do is to synchronize the master on the replica to use the replica as a backup server not High availability. So do i need to make rolling (as i understood, i think no! ?) Do i must put parameters at sync_client -u -v or can it sync every users and mailboxes (with -m) automatically? Can someone helps me please? Thanks a lot! -- Debut du message initial --- De : [EMAIL PROTECTED] A : info-cyrus@lists.andrew.cmu.edu Copies : Date : Mon, 26 Feb 2007 19:25:07 +0300 Objet : Re: Cyrus replication problems On Mon, Feb 26, 2007 at 02:35:05PM +0100, [EMAIL PROTECTED] wrote: I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=41779 You must start sync_client over different script AFTER starting cyrus imapd server. WBR -- Dmitriy Kirhlarov OILspace, 26 Leninskaya sloboda, bld. 2, 2nd floor, 115280 Moscow, Russia P:+7 495 105 7245 ext.208 F:+7 495 105 7246 E:[EMAIL PROTECTED] Building Successful Supply Chains - One Solution At A Time. www.oilspace.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus replication problems
Hy all, I get problems with replication. Once I enable replication on my imapd.conf with that options: # SYNC PARAMETERS sync_log: 1 sync_password: cyrus sync_host: imapreplica sync_realm: mydomain.com sync_authname: cyrus sync_machineid: 1 sync_repeat_interval: 3 Here is my full imapd.conf : configdirectory: /var/imap partition-default: /var/spool/imap allowplaintext: yes admins: cyrus reject8bit: no sieveusehomedir: false sievedir: /var/imap/sieve sasl_pwcheck_method: saslauthd tls_cert_file: /usr/local/etc/imaptest.cer tls_key_file: /usr/local/etc/imaptest.pem tls_ca_file: /usr/local/etc/ca.ca sync_log: 1 sync_password: cyrus sync_host: imapreplica sync_realm: netasq.com sync_authname: cyrus sync_machineid: 1 sync_repeat_interval: 3 I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server If i remove those lines in imapd.conf it works. The second problems is that replication doesn't works at all. I can on my first server make an : imtest -u cyrus -a cyrus -t -m PLAIN imapreplica and authenticate. If i run sync_client -u -v , i get : Can not connect to server 'imapreplica', retrying in 15 seconds Is there someone else who can help me please? Thanks, Nicolas. Envoyez vos cartes de voeux depuis www.laposte.net Elles seront ensuite distribuées par le facteur : pratique et malin ! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus replication problems
On Mon, Feb 26, 2007 at 02:35:05PM +0100, [EMAIL PROTECTED] wrote: I'm not able anymore to make as cyrus user a cyradm localhost I get : cyradm: cannot connect to server http://cyrusimap.web.cmu.edu/archive/message.php?mailbox=archive.info-cyrusmsg=41779 You must start sync_client over different script AFTER starting cyrus imapd server. WBR -- Dmitriy Kirhlarov OILspace, 26 Leninskaya sloboda, bld. 2, 2nd floor, 115280 Moscow, Russia P:+7 495 105 7245 ext.208 F:+7 495 105 7246 E:[EMAIL PROTECTED] Building Successful Supply Chains - One Solution At A Time. www.oilspace.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
