Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Jim Salter
No. Rsync has to build a list of *every single file in the filesystem*, along with - at a minimum - last modified datestamp. Rsync needs to be able to propagate deletions if necessary, and to do that, you have to compare the entire list of all files (not specifically excluded) in the specifie

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Greger Cronquist
But isn't building this exact file list what an ordinary call to rsync is supposed to do (when not forcing checksum calculation)? So why is rsync so much slower than find? /Greger Tim Conway wrote: Good idea find / -ctime -1h |rsync -a --files-from=- / destination No perl needed. You might wa

Re: Why does my cwrsync try to load ssh?

2004-03-22 Thread Jim Salter
It's trying to fire up ssh because your target has a single colon in it. server:/path/to/stuff means "fire up ssh or rsh and make me a tunnel to server" server::module/path/to/stuff means "try to access an rsync daemon on server and access path/to/stuff on module" /path/to/stuff means "access

Why does my cwrsync try to load ssh?

2004-03-22 Thread Rob Jellinghaus
Just installed cwrsync 1.2.1 and I am getting this: C:\cwrsync>rsync -n -v -r /cygdrive/c/robj/pickmeup speedball3:/cygdrive/d/robj/pickmeup Failed to exec ssh : No such file or directory rsync error: error in IPC code (code 14) at pipe.c(81) rsync: connection unexpectedly closed (0 bytes read so

Re: orphan dirs and files with --delete

2004-03-22 Thread Eric Whiting
I still get the same error with --force --delete. There needs to be a chmod on dir before the files and dir can be deleted. eric Tim Conway wrote: > > --force force deletion of directories even if > not empty > > SunOS 5.8 Last change: 26 Jan 2003

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Clint Byrum
On Mon, 2004-03-22 at 17:16, Jim Salter wrote: > But why would you want to use rsync if you've already built your file > list? Seems kinda pointless... I mean if it got touched, you definitely > want to copy it, so, yeah. =) > And so it seems we've come full circle back to just use tar. ;-)

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Jim Salter
But why would you want to use rsync if you've already built your file list? Seems kinda pointless... I mean if it got touched, you definitely want to copy it, so, yeah. =) Jim Salter Good idea find / -ctime -1h |rsync -a --files-from=- / destination No perl needed. You might want mtime instea

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Tim Conway
Good idea find / -ctime -1h |rsync -a --files-from=- / destination No perl needed. You might want mtime instead, though. Tim Conway Unix System Administration Contractor - IBM Global Services desk:3032734776 [EMAIL PROTECTED] Jim Salter <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 03/22/20

Re: orphan dirs and files with --delete

2004-03-22 Thread Tim Conway
--force force deletion of directories even if not empty SunOS 5.8 Last change: 26 Jan 20037 User Commandsrsync(1) That should do it. Tim Conway Unix System Administration Contractor - IBM Global

orphan dirs and files with --delete

2004-03-22 Thread Eric Whiting
rsync (2.5.[67]) --delete fails on dirs with the w bit cleared. (example below) Rsync will sync a dir with w bit clear, but will not remove it with --delete. This is not a big problem, but it will create situations where there are 'orphaned' files. Has anyone else had this problem? It looks li

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Jim Salter
This does bring up one point though. Is there any way to optimize file list building? It seems like that turns into a huge bottleneck in the "lots of files" situation. If you already know you're working with a mirror on the other end, and you know when your last sync was, and you're a moderately d

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Mark Thornton
Clint Byrum wrote: This does bring up one point though. Is there any way to optimize file list building? It seems like that turns into a huge bottleneck in the "lots of files" situation. Only by having a process which continuously monitors the relevant directory trees to maintain a list of the

rsync returned 23

2004-03-22 Thread Ian Clancy
Hello Rsync users, I,m using rsnapshot, an incremental backup too based on rsync to backup data from remote servers using ssh. The data mainly consists of windows shares (samba & windows NT4 Server). Most of the shares backup ok but when backing up some shares the following error is recorded in

rsync via ssh script

2004-03-22 Thread Tim Nonnast
Hi, does anybody know, how a bash shell script looks, which automatically enters the ssh password? the rsync call should be: rsync -avz -e ssh /home/johndoe/data/repository [EMAIL PROTECTED]:/home/johndoe/junk the call causes a password question. Is ist possible to automate that by a cron? If

Re: Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Clint Byrum
On Mon, 2004-03-22 at 04:42, Hergaarden, Marcel wrote: > We're running rsync 2.5.7 on a Windows2000 server, in combination with > cygwin/ssh. The server who receives the data is a Linux server. > > The amount of data from the Windows server is about 100 Gb. Represented > by 532.000 files of differ

Can tar be piped through rsync?

2004-03-22 Thread prosolutions
I am trying to work out a backup solution whereby an entire Linux drive can be rsynced to a mounted external firewire/usb hard drive that has a vfat filesystem on it. To preserve ownership and permissions it is necessary to do something like tar -cf dir1.tar dir1/ | rsync /win/rsync however thi

Re: Odd behavior with rsync/ssh/--delete

2004-03-22 Thread Wayne Davison
On Sun, Mar 21, 2004 at 09:51:18PM -0700, Peter Wargo wrote: > However, my syncs are much bigger then they should be. I'm getting a > bunch more than I expect - files that haven't changed in a long time > are being deleted and re-sync'd. Does the destination system have any mounted filesystems in

remote site deletes need to propagate back to master site.

2004-03-22 Thread John Sharp
Hi, I've just started with rsync and have it running in daemon mode on my remote site. I would like the remote site to be able to delete directories and have these deletes "reflected" back to the "master" site. Reading thru the docs, its says this is possible, but I can't figure out how to set t

Long time needed for "Building file list" Any suggestions ?

2004-03-22 Thread Hergaarden, Marcel
We're running rsync 2.5.7 on a Windows2000 server, in combination with cygwin/ssh. The server who receives the data is a Linux server. The amount of data from the Windows server is about 100 Gb. Represented by 532.000 files of different nature. Mostly doc, ppt and xls files. It takes about 2 ho