Re: find out the meaning of rsync error code
Stuart, This problem is harassing us since long now. It occurs only when we run rsync in daemon mode and on remote sites. It works perfectly fine if source and destination are in same site. We have tried --blocking-io and also ran rsync manually but still no luck. We are not able to find what is the actual problem. Could you please help us here. Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: Correct. -- Stuart Halliday I think there is no bulletproof solution for this. Right? Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: When I get errors like that I do a manual rsync command via a terminal (or command prompt) shell which tries to list the contents of either side of the connection. This at least shows you if the connection and rsync is working. ie rsync -v metatex.org::minimals-temp/test/ or rsync /cygdrive/c/ -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: Stuart Halliday stua...@ecs-tech.com Date: Tue, 20 Jan 2009 16:18:25 +0530 Subject: Re: find out the meaning of rsync error code Thanks Sven and Stuart for reply. They both are running at the same version 2.6.0 but still it gives same error. It was working fine since months but just now it has started throwing below error. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: See bottom of Man page @ http://www.samba.org/ftp/rsync/rsync.html EXIT Values 12 is: Error in rsync protocol data stream I suggest that this may be caused by you using two different versions of Rsync? Please check that the daemon and client are running the same version. -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: rsync@lists.samba.org Date: Tue, 20 Jan 2009 15:25:05 +0530 Subject: find out the meaning of rsync error code Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
I missed one point is that: It is also works between remote sites when we run rsync as a client-server normally.(i.e.non-daemon mode). Thanks. On 1/21/09, Jignesh Shah jignesh.shah1...@gmail.com wrote: Stuart, This problem is harassing us since long now. It occurs only when we run rsync in daemon mode and on remote sites. It works perfectly fine if source and destination are in same site. We have tried --blocking-io and also ran rsync manually but still no luck. We are not able to find what is the actual problem. Could you please help us here. Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: Correct. -- Stuart Halliday I think there is no bulletproof solution for this. Right? Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: When I get errors like that I do a manual rsync command via a terminal (or command prompt) shell which tries to list the contents of either side of the connection. This at least shows you if the connection and rsync is working. ie rsync -v metatex.org::minimals-temp/test/ or rsync /cygdrive/c/ -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: Stuart Halliday stua...@ecs-tech.com Date: Tue, 20 Jan 2009 16:18:25 +0530 Subject: Re: find out the meaning of rsync error code Thanks Sven and Stuart for reply. They both are running at the same version 2.6.0 but still it gives same error. It was working fine since months but just now it has started throwing below error. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: See bottom of Man page @ http://www.samba.org/ftp/rsync/rsync.html EXIT Values 12 is: Error in rsync protocol data stream I suggest that this may be caused by you using two different versions of Rsync? Please check that the daemon and client are running the same version. -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: rsync@lists.samba.org Date: Tue, 20 Jan 2009 15:25:05 +0530 Subject: find out the meaning of rsync error code Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync with OS X 10.3
Hi Jason,
Here's rsync10.3xattr_supportv0.6.diff.
You can find fileflags.diff and crtimes.diff (that are not from me,
but I strongly recommend you to install) here: http://samba.anu.edu.au/ftp/rsync/src/rsync-patches-3.0.5.tar.gz
As you could see in the mail from the mail-list, this version have a
bug with filenames containing slashes (/). They are converted to
colons (:) in the filesystem and we need to reconvert them to
slashes in order to pass them correctly as argument for the
FSMakeFSRefUnicode function. As you can see, we are looking for the
most efficient way to do it.
If you want to be sure it works, modify /lib/sysxattrs.c including
this code on fsreffrompath function:
= if(verbose 3)
= fprintf(stderr, name=%s\n,startOfName);
+ nameLength=strlen(startOfName);
+ strcpy(name, startOfName);
+ while(indexnameLength)
+ {
+ if(name[index]==':')
+ name[index]='/';
+ index++;
+ }
= cfStringName=CFStringCreateWithCString(NULL, name,
kCFStringEncodingUTF8);
= if(cfStringName==NULL)
Putting this initialisation:
= char parentPath[MAXPATHLEN+1], name[MAXNAMLEN+1];
+ unsigned int index=0, nameLength;
= means code that already exist on file.
+ means new code to be inserted in this context.
Other ways to make the colon to slash conversion are unsure and need
testing. If you would like to test it, let me know.
I can't test as I haven't a Mac OS X.3 anymore. Let me know as well if
this works for you (This patch have no guarantee, using it is by your
only responsibility).
Best regards,
Vitorio
PS: CC me if you reply on the mailing list as I don't systematically
subscribe to it.
Le 21 janv. 09 à 07:47, Jason a écrit :
Hi Vitorio,
I read your posting from Jan 20th 2009 regarding the email from
Tim. I'm not sure if you have the time but I have 2 computers
running 10.3 right now that I would love to have rsync 3 running on.
I'm running a mixed environment of 10.4 and 10.3 so right now I have
RsyncX installed on all the machines but it appears rsync 3 handles
things a bit better.
If you have the time send me the 10.3 diff file and I can try
compling with 10.3. My programming is primarily in ancient C
development for back end processing so I'm a bit rusty.
Cheers,
Jason
---
JOS
__
Instant Messaging, free SMS, sharing photos and more... Try the new
Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/
rsync10.3xattr_supportv0.6.diff
Description: Binary data
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
I'd recommend that you do a search on the failing systems for duplicate or old copies of Rsync. It just takes a PATH variable to include another old copy of rsync to make it fail. I'd also check your firewall or router aren't the problem. If you need to, temporary disable the firewall or any AV software as these can be potential problems. Also are you using SSH on these systems? Perhaps that isn't working? I'd start with the very simplest set up and go from there. For example manually start up a daemon on a remote server and see if a client can connect to its resources. Try a different port number, some thing may be blocking the value you're using. P.S. No need to send me a personal copy of your reply. I do read the mailing list. I get quite enough email thanks. :-) -- Stuart Halliday This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync with OS X 10.3
Hi folks,
I've made a Unicode test here and it seem safe to patch my Panther
patch in this way:
+ unsigned int index=0;
= CFStringGetCharacters(cfStringName, range, unicharName);
while(indexrange.length)
{
if(unicharName[index]==0x003B) /* == ':' */
unicharName[index]=0x002F; /* == '/' */
index++;
}
= carbon_error=FSMakeFSRefUnicode(parentRef, range.length,
unicharName, kTextEncodingUnknown, ref);
Because the length doesn't mean the number of printable characters,
but the number of Unicode signs. (A character can take more than one
Unicode sign.) So, it seem OK for me to scan the Unicode array on this
way.
If you patch your rsync with this modification on y patch, please let
me know if it works for you as I can't test it.
Best regards,
Vitorio
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
On Tue, Jan 20, 2009 at 10:16:37AM +, Stuart Halliday wrote: I suggest that this may be caused by you using two different versions of Rsync? Please check that the daemon and client are running the same version. The only known issues of cross-version incompatibility have been fixed. If you know of any more, please let the list know. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
On Tue, Jan 20, 2009 at 03:25:05PM +0530, Jignesh Shah wrote: In rsync return code: 12 error, what 12 indicates? The error code is pretty inconsequential compared to the errors that come before it. See what rsync is actually complaining about, and make sure you know if there is an issue with the remote side or the local side. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Should posters be required to join the list? (was: Bad habits)
On Thu, 2008-03-20 at 11:52 -0400, Matt McCutchen wrote: Why are non members even allowed to post to the list? Why shouldn't they be? In my view, subscription to the list just indicates a personal preference to receive all the mail because one wishes to either help others or stay informed of rsync-related happenings. There's no reason why people who have one question but aren't otherwise interested in rsync should be forced to subscribe. I'm shifting my position on this issue because I've seen several problems that would be solved by requiring posters to join the list: 1. The following has happened at least once (I don't have a count): A nonmember posts and receives notice that the message is held for moderation. He/she joins the list and resends the message; in the meantime, I approve the old message because it is not spam. The result is a duplicate message. If nonmember posts were rejected instead of being held for moderation, this couldn't happen. 2. A user who I am helping neglects to CC the list on messages after his/her first. The line Wayne added to the footer of list messages hasn't seemed to help, probably because the user receives my message directly and nodupes suppresses the list message. If posters were required to join the list, the welcome message could clue them in to our basic expectations, including this one. (Note that another possible solution here is Reply-To munging. Wayne was reluctant to enable it because it might trick people into sending private messages to the list, but in my experience, the reverse problem is much more common.) Under the new model, list membership would indicate willingness to participate on the list according to proper etiquette, but would *not* entail receiving all the mail: users are welcome to disable mail delivery in their member options. That means we still cannot assume that everyone interested in a thread receives list mail, so the arguments put forth in the Bad habits thread for CC-ing interested parties directly still hold. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: webdav timeout
Helge, please CC rsync@lists.samba.org in your replies so your messages are archived for others' future benefit. On Wed, 2009-01-21 at 19:48 +0100, Kraak Helge wrote: Thanks for your reply Matt! I now tested two different commands with two different versions of rsync. Once I used the timeout option and once I didn't. When I don't use the timeout option I don't get any error and the upload to the webdav server works for all files (with 2.6.9 and with 3.0.5), but there's a long break (I guess about 60-90 minutes) between the large files with size of 50 Megabytes and 100 Megabyte. I see. Then the underlying problem is the slowness of the operation; obviously, if you set a timeout, rsync will give up after being stalled for that amount of time. We can still try to determine whether the slowness is the fault of rsync or the WebDAV client. I uploaded all system call traces to this address as I don't know which parts of the files are relevant for you: http://kraak.info/rsync/ rsync_system_call_trace_3.0.5.txt is the case I care about (recent version of rsync, no timeout). Could you obtain a new trace that shows the time (either relative or absolute) of each line? Without that, it's impossible to tell where the 60-minute delay is. Incidentally, I wonder if the WebDAV client is performing the final rename in a silly way, such as by downloading and re-uploading the file instead of using the WebDAV MOVE method. If that's the problem, you could work around it by passing --inplace to rsync. Or it could be that the WebDAV client buffers all the data rsync writes to a destination file and does not actually upload anything until rsync closes the file (like AFS); in that case, rsync would see a long delay and there's really nothing that can be done about it. Without timeout: /usr/local/bin/rsync --size-only --human-readable --progress -- recursive --delete --bwlimit=50 --times --stats /Users/Helge/ temp /Volumes/webdav.macbay.de/backup/temp /users/Helge/Pictures/ rsync_Pictures_` date +%Y_%m_%d__%H_%M`.log As said: No error messages when I don't use a timeout but it takes several hours to upload the files. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync with OS X 10.3
Alright here is an update.
Using v0.6 + standard OS X patches + code below I have compiled rsync 3.0.5 on
a OS X 10.3 box.
No errors were thrown during the compile. In order to test this build I
created the Src and Dst volumes using the Backup Bouncer test suit. This was
performed on a 10.4 system. The disk images where transfered to the 10.3
system. The results of the test are:
Verifying:basic-permissions ... ok (Critical)
Verifying: timestamps ... ok (Critical)
Verifying: symlinks ... ok (Critical)
Verifying:symlink-ownership ... ok
Verifying:hardlinks ... FAIL (Important)
Verifying: resource-forks ...
Sub-test: on files ... FAIL (Critical)
Sub-test: on hardlinked files ... FAIL (Important)
Verifying: finder-flags ... FAIL (Critical)
Verifying: finder-locks ... FAIL
Verifying:creation-date ... FAIL
Verifying:bsd-flags ... FAIL
Verifying: extended-attrs ...
Sub-test: on files ... FAIL (Important)
Sub-test: on directories ... FAIL (Important)
Sub-test: on symlinks ... FAIL
Verifying: access-control-lists ...
Sub-test: on files ... FAIL (Important)
Sub-test: on dirs ... FAIL (Important)
Verifying: fifo ... ok
Verifying: devices ... ok
Verifying: combo-tests ...
Sub-test: xattrs + rsrc forks ... FAIL
Sub-test: lots of metadata ... FAIL
I'm a little surprised by the hardlinks and resource-forks but otherwise this
is what we got.
When transferring both files and directories with '/' in their filename they
were transfered over without any difficulties.
Thoughts on how we can proceed? Or is testing this copy not a valid method.
Cheers,
Jason
--- On Wed, 1/21/09, macuserfr macuse...@free.fr wrote:
From: macuserfr macuse...@free.fr
Subject: Re: Rsync with OS X 10.3
To: dualusbib...@yahoo.ca
Cc: rsync@lists.samba.org
Received: Wednesday, January 21, 2009, 4:03 AM
Hi Jason,
Here's rsync10.3xattr_supportv0.6.diff.
You can find fileflags.diff and crtimes.diff (that are not
from me, but I strongly recommend you to install) here:
http://samba.anu.edu.au/ftp/rsync/src/rsync-patches-3.0.5.tar.gz
As you could see in the mail from the mail-list, this
version have a bug with filenames containing slashes
(/). They are converted to colons
(:) in the filesystem and we need to reconvert
them to slashes in order to pass them correctly as argument
for the FSMakeFSRefUnicode function. As you can see, we are
looking for the most efficient way to do it.
If you want to be sure it works, modify /lib/sysxattrs.c
including this code on fsreffrompath function:
= if(verbose 3)
= fprintf(stderr, name=%s\n,startOfName);
+ nameLength=strlen(startOfName);
+ strcpy(name, startOfName);
+ while(indexnameLength)
+ {
+ if(name[index]==':')
+ name[index]='/';
+ index++;
+ }
= cfStringName=CFStringCreateWithCString(NULL, name,
kCFStringEncodingUTF8);
= if(cfStringName==NULL)
Putting this initialisation:
= char parentPath[MAXPATHLEN+1], name[MAXNAMLEN+1];
+ unsigned int index=0, nameLength;
= means code that already exist on file.
+ means new code to be inserted in this context.
Other ways to make the colon to slash conversion are unsure
and need testing. If you would like to test it, let me know.
I can't test as I haven't a Mac OS X.3 anymore. Let
me know as well if this works for you (This patch have no
guarantee, using it is by your only responsibility).
Best regards,
Vitorio
PS: CC me if you reply on the mailing list as I don't
systematically subscribe to it.
Le 21 janv. 09 à 07:47, Jason a écrit :
Hi Vitorio,
I read your posting from Jan 20th 2009 regarding the
email from Tim. I'm not sure if you have the time but I
have 2 computers running 10.3 right now that I would love to
have rsync 3 running on.
I'm running a mixed environment of 10.4 and 10.3
so right now I have RsyncX installed on all the machines but
it appears rsync 3 handles things a bit better.
If you have the time send me the 10.3 diff file and I
can try compling with 10.3. My programming is primarily in
ancient C development for back end processing so I'm a
bit rusty.
Cheers,
Jason
---
JOS
__
Instant Messaging, free SMS, sharing photos and
more... Try the new Yahoo! Canada Messenger at
http://ca.beta.messenger.yahoo.com/
__
Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
favourite sites. Download it now at
http://ca.toolbar.yahoo.com.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options:
How to setup and configure rsync with backupPC
Dear all,Could you please explain me how do backupPC and rsync work together?I am a new user to debian linux and i would like to setup backupPC and rsync to backup all user data in my network. Could you tell me how to do that?Thank youMolin -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: How to setup and configure rsync with backupPC
On Wed, 2009-01-21 at 19:37 -0800, Molin MEN wrote: Could you please explain me how do backupPC and rsync work together? I am a new user to debian linux and i would like to setup backupPC and rsync to backup all user data in my network. Could you tell me how to do that? This isn't really an rsync question. BackupPC supports rsync as one way to pull data from the machines to be backed up, and the BackupPC documentation tells you how to set up rsync for this purpose: http://backuppc.sourceforge.net/faq/BackupPC.html#step_5__client_setup -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
