rsync and symlinks

2009-09-01 Thread Jignesh Shah
Hi, I have one question regarding handling of symlinks in rsync. If I have /source directory in which I have 100s of sub directories of directories and each one has symlink to some directories out side the /source directory hierarchy. Does rsync follows all those symlinks and syncs the data if I

Re: rsync and symlinks

2009-09-01 Thread Jignesh Shah
Thanks Carlos. ... rsync copy symlinks as symlinks What about the contents pointed by simlinks? Could you please also elaborate on Only if it's inside source. Thanks, Jignesh On Tue, Sep 1, 2009 at 8:25 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: Jignesh Shah (jignesh.shah1

snapshot support in rsync

2009-08-27 Thread Jignesh Shah
Hi, I have been using rsync-3.0.6 to sync my huge file system and it works awesome. I have been getting really annoying lots of errors about file has vanished. We thought on getting rid of this and realized that having snapshot support in rsync would make things much easier. Could you please let

rsync-3.0.6 IO Time out

2009-07-30 Thread Jignesh Shah
Hi, We have been facing strange(for me) behavior while synching a file system. Error while syncing /projects/list/: io timeout after 43211 seconds -- exiting Error while syncing /projects/list/: rsync error: timeout in data send/receive (code 30) at io.c(200) [sender=3.0.6] From rsync man

Re: Need help of exclusion options in rsync-3.0.6

2009-07-27 Thread Jignesh Shah
...@mattmccutchen.netwrote: On Sun, 2009-07-26 at 21:37 +0530, Jignesh Shah wrote: I have a situation where I want to delete some of my excluded patterns but still want to preserve some other. For example consider below source and destination directory hierarchy. SourceDest

Re: Need help of exclusion options in rsync-3.0.6

2009-07-27 Thread Jignesh Shah
Yup, it is working. On Mon, Jul 27, 2009 at 7:42 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: Matt McCutchen (m...@mattmccutchen.net) wrote on 26 July 2009 17:45: On Sun, 2009-07-26 at 21:37 +0530, Jignesh Shah wrote: I have a situation where I want to delete some of my excluded

Need help of exclusion options in rsync-3.0.6

2009-07-26 Thread Jignesh Shah
Hi, I have a situation where I want to delete some of my excluded patterns but still want to preserve some other. For example consider below source and destination directory hierarchy. SourceDest -- - /foo/bar/ /foo/bar/

Lots of file exists errors with rsync version 3.0.6

2009-07-21 Thread Jignesh Shah
Hi, we have started getting file exists ~100s errors every day. I think we never got it with rsync 2.6.9. Is there anything changed in new version that has been generating these errors? Error while syncing /usr/local/theapp/: rsync: symlink /usr/local/theapp/2009.uv - ../thedt.uv failed: File

difference between --no-implied-dir abd --keep-dirlinks ?

2009-06-28 Thread Jignesh Shah
Hi, I have gone through the rsync documentation and also tested same both --no-implied-dir and --keep-dirlinks options. My question is what is the difference between these options in below scenario? I have /foo/bar is the symlink to /foo/baz at source and same directory structure with symlink

Re: could not make way for new symlink !!!

2009-06-07 Thread Jignesh Shah
You are correct Carlos but it wasn't happening with rsync-2.6 and started happening with rsync-3.0.6. Do you have any idea on this? On Sat, Jun 6, 2009 at 12:12 AM, Carlos Carvalho car...@fisica.ufpr.brwrote: Jignesh Shah (jignesh.shah1...@gmail.com) wrote on 5 June 2009 18:16: Could any one

could not make way for new symlink !!!

2009-06-05 Thread Jignesh Shah
Could any one please help me to get rid of below errors? ERROR: DoRsync(): rsync had errors or failed rsync return code: 23 could not make way for new symlink: bin could not make way for new symlink: etc could not make way for new symlink: include rsync error:

rsync and snapshots

2009-05-30 Thread Jignesh Shah
Hi, when file is unavailable (or vanished), is there any way to tell rsync to retrieve file from snapshot? Any other idea? Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before

Re: rsync-3.0.6 prints file list generation time wrong ???

2009-05-30 Thread Jignesh Shah
) stats.flist_buildtime = 1; Is there any way I can find out how much time rsync spends in complete file list generation? Jignesh. On Sat, May 30, 2009 at 10:42 PM, Wayne Davison way...@samba.org wrote: On Fri, May 29, 2009 at 06:29:22PM +0530, Jignesh Shah wrote: Does that mean rsync

rsync-3.0.6 prints file list generation time wrong ???

2009-05-29 Thread Jignesh Shah
Hi, While researching on where rsync-3.0.6 spending more time when we have huge number of files in directory(~1000K files). I got below statistics: 2009/05/28 19:05:38 [9660] building file list . . . 2009/05/28 21:40:09 [9660] Number of files: 724591 2009/05/28 21:40:09 [9660] Number of

some files vanished before they could be transferred

2009-05-28 Thread Jignesh Shah
Hi, I am getting rsync warning: some files vanished before they could be transferred (code 24) at main.c(1039) [sender=3.0.6] now frequently but while using rsync version 2.6, I used to get it rarely. Any idea would be helpful on why rsync 3.0.6 is throwing this warning frequently. Jignesh. --

Re: some files vanished before they could be transferred

2009-05-28 Thread Jignesh Shah
I wonder why rsync-3.0.6 don;t have --ignore-vanished-files option? Jignesh On Thu, May 28, 2009 at 12:39 PM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I am getting rsync warning: some files vanished before they could be transferred (code 24) at main.c(1039) [sender=3.0.6] now

Re: some files vanished before they could be transferred

2009-05-28 Thread Jignesh Shah
was not aware of this flag. But I am interested to know why it is not in 3.0.6 if this is the case. It seems like a good option to have available. On 28/05/2009, at 9:16 PM, Jignesh Shah wrote: I wonder why rsync-3.0.6 don;t have --ignore-vanished-files option? Jignesh On Thu, May 28, 2009

Re: incremental directory searche in rsync 3.0.6

2009-05-19 Thread Jignesh Shah
Thanks Matt, does that means, in incremental recursion (to create the missin dirs), --implied-dirs/--no-implied-dirs has no importance? Jignesh. On Tue, May 19, 2009 at 11:24 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-19 at 10:58 +0530, Jignesh Shah wrote: I

Re: incremental directory searche in rsync 3.0.6

2009-05-19 Thread Jignesh Shah
O... If I am not wrong then this behavior is same from older rsync2.6.0 to latest rsync3.0.6. Thanks. On Tue, May 19, 2009 at 12:33 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-19 at 12:19 +0530, Jignesh Shah wrote: Thanks Matt, does that means, in incremental

ESTALE error while synching

2009-05-19 Thread Jignesh Shah
Hi, I am wondering how rsync-3.0.6 react if it encounters ESTALE error while synching? If I remember correctly then the rsync-2.6.0 skipping that file/dir in case of ESTALE error. Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change

Re: ESTALE error while synching

2009-05-19 Thread Jignesh Shah
, Jignesh Shah wrote: Hi, I am wondering how rsync-3.0.6 react if it encounters ESTALE error while synching? If I remember correctly then the rsync-2.6.0 skipping that file/dir in case of ESTALE error. If rsync encounters any kind of error reading a source file, it will report the error

incremental directory searche in rsync 3.0.6

2009-05-18 Thread Jignesh Shah
Hi, I was in under impression that rsync 3.0.5/3.0.6 creates all the missing directories in the path but I think I am wrong. Could any one tell me is it possible to create all missing dirs in path at destination side if not exists. Currently, I have been getting below errors. rsync -avz

Any idea on this rsync error?

2009-05-13 Thread Jignesh Shah
Hi, we have been getting this errors frequently. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (7087269 bytes read so far)

Re: Going to upgrad rsync V2.6.7 to V3.0.5

2009-05-09 Thread Jignesh Shah
Big Thanks Wayne for your valuable information. -Jignesh On Sat, May 9, 2009 at 12:09 AM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:50:40PM +0530, Jignesh Shah wrote: I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then rsync

Re: %h %a %u string in --log-file-format doesn't work

2009-05-08 Thread Jignesh Shah
Ohhh,,..Thanks Wayne...Got it.. Thanks, Jignesh On Thu, May 7, 2009 at 8:40 PM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:42:28PM +0530, Jignesh Shah wrote: It does't include the host name, IP address and authenticated user name and instead it keep it as %h %a %u

Re: Needs suggestion in using --relative with /./ feature in rsync 3.0.5

2009-05-08 Thread Jignesh Shah
fixes after rsync 3.0.5 release. *Do I have to patch all the bug fixes or its fine if I use only rsync 3.0.5?* Thanks, Jignesh On Thu, May 7, 2009 at 8:43 PM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:59:34PM +0530, Jignesh Shah wrote: I just need to execute rsync

%h %a %u string in --log-file-format doesn't work

2009-05-07 Thread Jignesh Shah
Hi, I have been using --log-file-format and --log-file options in following way in rsync-3.0.5 rsync -avz -ii --log-file-format='%h %a %m %u %i %f %l %o %b' --log-file='/tmp/myfile' /src /dest It does't include the host name, IP address and authenticated user name and instead it keep it as %h

Going to upgrad rsync V2.6.7 to V3.0.5

2009-05-07 Thread Jignesh Shah
Hi, We have been planning to upgrad rsync 3.0.5. I have some question on this so that we will not screwed up the file systems. We have been using rsync 2.6.7 since long and we didn't have any major problems. I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then

Needs suggestion in using --relative with /./ feature in rsync 3.0.5

2009-05-07 Thread Jignesh Shah
Hi, I came across --relative option in rsync 3.0.5 and that looks awesome option through which we can avoid CD usage in base directory. Suppose I want to sync the file from /foo/bar/baz/* to /tmp/bar/baz/ then we have been using wrapper script that do cd /tmp before executing rsync --relative

Problem with --fil

2009-05-04 Thread Jignesh Shah
Hi, I am using below command. rsync --verbose --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' src/ dest/ Though it is good that all the sync information contents will be redirected to /tmp/myfile, it would be useful if rsync could print at least below final statistics on stdout.

Re: Problem with --fil

2009-05-04 Thread Jignesh Shah
Hey Matt, OK it is displaying the statistics with --states on stdout as well but I think format has been changed than rsync 2.6.7. Am I right? Thanks, Jignesh On Tue, May 5, 2009 at 12:59 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Thanks for reply but I have been passing --states option

Re: Problem with --fil

2009-05-04 Thread Jignesh Shah
Shah jignesh.shah1...@gmail.comwrote: Hey Matt, OK it is displaying the statistics with --states on stdout as well but I think format has been changed than rsync 2.6.7. Am I right? Thanks, Jignesh On Tue, May 5, 2009 at 12:59 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Thanks

Re: Problem with --fil

2009-05-04 Thread Jignesh Shah
Thanks Matt, that has solved my problem. Thanks, Jignesh On Tue, May 5, 2009 at 1:16 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-05 at 01:08 +0530, Jignesh Shah wrote: I think I got it. The line in rsync 2.6.7 wrote 130 bytes read 464 bytes 108.00 bytes/sec is changed

The --relative option on remote machine to source machine ???

2009-05-02 Thread Jignesh Shah
Hi, I read below lines in rsync v3.0.5 for --relative option. if you used this command: rsync -av /foo/bar/baz.c remote:/tmp/ ... this would create a file named baz.c in /tmp/ on the remote machine. If instead you used rsync -avR /foo/bar/baz.c remote:/tmp/ then a file named /tmp/foo/bar/baz.c

Re: The --relative option on remote machine to source machine ???

2009-05-02 Thread Jignesh Shah
Sorry guys, I was using rsync 2.6.7 in rsync -avR remote:/foo/./bar/. /tmp/ command. In rsync v3.0.5 it works as expected. Thanks, Jignesh On Sun, May 3, 2009 at 12:07 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I read below lines in rsync v3.0.5 for --relative option. if you used

Overwrite the log-file in rsync3.0.5

2009-04-21 Thread Jignesh Shah
Hi, Could any one please let me know if there is anyway to overwrite the log-file if it already exists. I want /tmp/mylogs/myfile file to be overwritten each time below command executes. rsync -av -ii file-format='MyLogs: %i %f %l %o %b' --log-file='/tmp/mylogs/myfile' Thanks,

Overwrite the rsync log-file in rsync3.0.5 ??

2009-04-17 Thread Jignesh Shah
Hi, Could any one please let me know if there is anyway to overwrite the log-file if it already exists. I want /tmp/mylogs/myfile file to be overwritten each time below command executes. rsync -av -ii file-format='MyLogs: %i %f %l %o %b' --log-file='/tmp/mylogs/myfile' Thanks,

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-07 Thread Jignesh Shah
to the file. Thanks. On Mon, Apr 6, 2009 at 12:24 PM, David Overton da...@overtons.id.au wrote: Pipe the output through sed? 2009/4/6 Jignesh Shah jignesh.shah1...@gmail.com: Thanks Wayne for reply. I want to use log-file support only so that i need not to read stdout and put output

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-07 Thread Jignesh Shah
If you just want to log transferred files, No, I also want to log files that are not transferred. Thanks, Jignesh On Tue, Apr 7, 2009 at 8:04 PM, Wayne Davison way...@samba.org wrote: On Mon, Apr 06, 2009 at 10:45:42AM +0530, Jignesh Shah wrote: I have to use -ii so that it print all

Re: cryptic output with itemized option

2009-04-05 Thread Jignesh Shah
in it (e.g. cd+ , f+ etc). If we remove it then it will become similar output as 2.6.* version output. Is it possible? Thanks, Jignesh On Thu, Apr 2, 2009 at 2:49 PM, Paul Slootman paul+rs...@wurtel.netpaul%2brs...@wurtel.net wrote: On Thu 02 Apr 2009, Jignesh Shah wrote: Could

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-05 Thread Jignesh Shah
in it (e.g. cd+ , f+ etc). If we remove it then it will become similar output as 2.6.* version output. Is it possible? Thanks, Jignesh On Thu, Apr 2, 2009 at 8:14 PM, Wayne Davison way...@samba.org wrote: On Wed, Apr 01, 2009 at 10:50:13AM +0530, Jignesh Shah wrote: I noticed

cryptic output with itemized option

2009-04-02 Thread Jignesh Shah
Hi, Could any one please tell me if there is any way to remove 11 letters long cryptic output from -ii option. I am using rsync 3.0.5 rsync -av -stats -ii --log-file-format='CONTENTS: %i %f %l %o %b' --log-file='/tmp/rsync-test' Mydocs/ Mydocs1/ The output of this command: 2009/03/31 15:15:17

itemized option (-ii) with --log-file and --log-file format

2009-03-31 Thread Jignesh Shah
Hi, I am using rsync3.0.5 both side. I have been using below rsync command to get the sync info. rsync -av --stats -ii --log-file-format='CONTENTS: %i %f %l %o %b' --log-file='/tmp/rsync-test' src/ dest/ I noticed that the output format for this command is different from rsync V2.6.* . Is there

Re: how rsync calculate Tranfer rate ??

2009-03-02 Thread Jignesh Shah
includes? 2. How transfer rate is 170583.48 bytes/sec? Could someone please help me here. Thanks, Jignesh On Mon, Mar 2, 2009 at 1:36 PM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I am not sure how rsync calculates below statistics and how transfer rate 170583.48 bytes/sec ? Where

Re: find out the meaning of rsync error code

2009-01-21 Thread Jignesh Shah
/ or rsync /cygdrive/c/ -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: Stuart Halliday stua...@ecs-tech.com Date: Tue, 20 Jan 2009 16:18:25 +0530 Subject: Re: find out the meaning of rsync error code Thanks Sven and Stuart

Re: find out the meaning of rsync error code

2009-01-21 Thread Jignesh Shah
I missed one point is that: It is also works between remote sites when we run rsync as a client-server normally.(i.e.non-daemon mode). Thanks. On 1/21/09, Jignesh Shah jignesh.shah1...@gmail.com wrote: Stuart, This problem is harassing us since long now. It occurs only when we run rsync

rsync invalid tag error

2009-01-20 Thread Jignesh Shah
Hi, Please let me know what what could be the cause of below error: ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes

find out the meaning of rsync error code

2009-01-20 Thread Jignesh Shah
Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

file count limit in rsync V3.0.4

2008-12-23 Thread Jignesh Shah
Hi Friends, Is there any limit in total files to be transfered in rsync V3.0.4? The rsync V3.0.4 has synching interleaved with file system walk and thus it uses much less memory so ideally it should not have any limit of total number of files to be transfered. Am I right? Thanks, Jignesh --

Re: file count limit in rsync V3.0.4

2008-12-23 Thread Jignesh Shah
m...@mattmccutchen.netwrote: On Tue, 2008-12-23 at 20:21 +0530, Jignesh Shah wrote: Is there any limit in total files to be transfered in rsync V3.0.4? There's no hard-coded limit, but memory is still a constraint... The rsync V3.0.4 has synching interleaved with file system walk

Re: logging mechanism in rsync

2008-12-23 Thread Jignesh Shah
, 2008 at 10:00 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2008-12-23 at 12:20 +0530, Jignesh Shah wrote: Thanks for the info. Basically I want to display all the files which has not transfer because the file has not changed. Can I use --info=skip for this? That would

Re: logging mechanism in rsync

2008-12-23 Thread Jignesh Shah
Thanks Matt. I thought V3.0.5 is the latest version. From where I can download 3.1.* ? Is it preview version? Thanks, Jignesh On Wed, Dec 24, 2008 at 9:43 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Wed, 2008-12-24 at 09:37 +0530, Jignesh Shah wrote: Could you please tell me why I am

Re: logging mechanism in rsync

2008-12-22 Thread Jignesh Shah
, Jignesh Shah wrote: Does rsync V3 has the feature for logging the files which have not been transferred? Out of what set do you want to see the files not transferred? - For files hidden by exclude rules, pass -vv (or --debug=exclude if your rsync is new enough to support it) and look for messages

Re: rsync architecture

2008-12-17 Thread Jignesh Shah
Thanks a lot Matt. I understood everying now. :-) On Wed, Dec 17, 2008 at 4:55 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Mon, 2008-12-15 at 10:14 +0530, Jignesh Shah wrote: I am trying to see the rsync source code. I could see that there are main three processes: I realize

logging mechanism in rsync

2008-12-16 Thread Jignesh Shah
Hi Friends, Does rsync V3 has the feature for logging the files which have not been transferred? Its already logs the file which have been transfered. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

Transfer mode

2008-12-16 Thread Jignesh Shah
Hello Friends, Could any one please tell me what is transfer mode and what are the transfer modes available in rsync? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync

rsync architecture

2008-12-14 Thread Jignesh Shah
Hi All, I am trying to see the rsync source code. I could see that there are main three processes: I realize that Server or Client becomes Sender or Receiver based on arguments provided. 1. Daemon start_daemon : clientserver.c 2. Server if(sender) { call

file system parsing question

2008-12-14 Thread Jignesh Shah
Hi Friends, Could any one tell me rsync start sending the changed file while parsing/walking file system or it starts sending one by one after complete file system walk completed. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or

use rsync 3.0.4

2008-12-10 Thread Jignesh Shah
Hello Friends, We are using rsync 2.6 and planning to switch to rsync 3.0.4 latest version. Could anyone tell me how would I get latest rsync version executable for unix different platform like sparc, i86 and linux? Also how would I know what are the changes made in rsync2.6 to rsync3.0.4?

File System walk in rsync

2008-12-10 Thread Jignesh Shah
Hello Friends, Could any atleast one tell me how rsync walk the complete File System and when it start actual synching? Thanks, Jignesh On Thu, Dec 4, 2008 at 1:32 PM, Jignesh Shah [EMAIL PROTECTED]wrote: Hi Friends, I think lot of changes have been made from rsync 2.6.0 to V3. The one

What does module option do?

2008-12-08 Thread Jignesh Shah
Hi, Could anyone please tell me what module option do in below rsync call and which case it is mandatory? rsync -av host::module /dest Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

changes in rsync V3

2008-12-04 Thread Jignesh Shah
Hi Friends, I think lot of changes have been made from rsync 2.6.0 to V3. The one major change is rsync V3 will not walk complete file system first and then start the synching but it will parallely start synching as well along with file system walking. Could any one tell me which source files got

Re: rssync source code as a windows project

2008-12-04 Thread Jignesh Shah
] wrote: Jignesh Shah wrote: Thanks for reply. Could you tell what do you mean by RTFM ctags and cscope,?? RTFM - Read The Manual ctags and cscope - utilities whose manual I think you should read. Creating a new project I think it will have so many errors. We can do it only if we know

how to get details of rsync source code?

2008-12-03 Thread Jignesh Shah
Hi Friends, I am new to rsync. I learnt the rsync algorithm and functionalities. It seems great. I want to dive into source code of rsync now. Could anyone suggest how should I proceed to understand the code. Is there any documentation about source code available? Basically I want to find out the

rssync source code as a windows project

2008-12-03 Thread Jignesh Shah
Hi Friends, I have started learning rsync source code but I am finding very difficult to go back and forth to find the execution flow. I could see that rsync code is written in UNIX and the compilation is difficult. Does anybody converted it into Windows Project so that we can open in using

Re: rssync source code as a windows project

2008-12-03 Thread Jignesh Shah
, Shachar Shemesh [EMAIL PROTECTED] wrote: Jignesh Shah wrote: Hi Friends, I have started learning rsync source code but I am finding very difficult to go back and forth to find the execution flow. I could see that rsync code is written in UNIX and the compilation is difficult. Does anybody