Re: Where is my bottleneck?

2004-03-11 Thread Marc Abel
I did some more investigating on the ssh slowdown theory... I also found one negative comment concerning my router (Linksys BEFSR81) which might be throughput-related. In a nutshell: ssh between these two machines can run at least 43 Mbit/s. I created a 100 Mbyte file from /dev/urandom, and ssh

Re: Feature Request: Multiple Streams

2004-03-11 Thread Jos Backus
On Thu, Mar 11, 2004 at 04:08:49PM -0800, Clint Byrum wrote: > This looks very promising. I have two concerns: > > 1) how bad is it if one of the batch destinations isn't exactly like the > original's destination was? Are we talking corruption, or will it say > "You screwed up, try again!" ? The

Re: Feature Request: Multiple Streams

2004-03-11 Thread Clint Byrum
On Thu, 2004-03-11 at 02:24, Stefan Nehlsen wrote: > You have one source and many destinations. This looks to me like you > want to use the batch options of rsync. > > Please read about batch mode in the rsync manpage. > This looks very promising. I have two concerns: 1) how bad is it if one of

Re: Where is my bottleneck?

2004-03-11 Thread Tim Conway
This seems obvious, but it's easy to forget. Are all the filesystems on both ends locally-attached? If they're NFS or SMBFS, rsync is about a third the speed of SCP, unless you use "-W" to tell it to send the whole file if the timestamp/size don't match... in most cases, anyway. ethernet lan

Re: rsync + ssh: fails from cron

2004-03-11 Thread Itay Furman
Thank you for your reply -- it is very helpful and makes things clearer to me. I will try the other approach that you have suggested, i.e., making the cron jobs part of the same process group. Thanks again, Itay On Thu, 11 Mar 2004, Larry Brasfield wrote: > Itay Furman wrote

Re: Where is my bottleneck?

2004-03-11 Thread Steve Bonds
On Thu, 11 Mar 2004, Marc Abel m-abel-at-columbus.rr.com |Rsync List| wrote: > I don't expect 100 Mbit/s by any means, but 2? Is this typical? What > am I missing? One good diagnostic would be to measure the network bandwidth between the two systems directly. I use netperf (http://www.netperf.

Re: Where is my bottleneck?

2004-03-11 Thread Cedric Puddy
On Thu, 11 Mar 2004, Marc Abel wrote: > Thanks to all three for your kindness. Invoked as: > > rsync -lave ssh --delete --delete-excluded \ > --exclude ".[!.]*" \ > /home/me [EMAIL PROTECTED]:composite_bu > > I did some looking around, and it seems like I haven't even installed > the daem

rsync

2004-03-11 Thread alexus
rsync -vcrlpogtz . [EMAIL PROTECTED]:/rsync/ [EMAIL PROTECTED]'s password: sh: rsync: rsync: connection unexpectedly closed (0 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) d# Any ideas why? -- To unsubscribe or change options: http://lists.samba.or

Re: Where is my bottleneck?

2004-03-11 Thread Marc Abel
Thanks to all three for your kindness. Invoked as: rsync -lave ssh --delete --delete-excluded \ --exclude ".[!.]*" \ /home/me [EMAIL PROTECTED]:composite_bu I did some looking around, and it seems like I haven't even installed the daemons for rsh, telnet, etc. (I'll follow up on this, b

Re: rsync + ssh: fails from cron

2004-03-11 Thread Larry Brasfield
Itay Furman wrote: > Hi, Greetings. > My ssh set up, on both 'work' and 'home' machines uses the > private-public key authentication (key uses non-empty > passphrase). So from the 'home' shell prompt the following > works without prompting to password or passphrase: > > rsync -avz --delete -e

Re: Feature Request: Multiple Streams

2004-03-11 Thread Stefan Nehlsen
On Tue, Mar 09, 2004 at 03:40:15PM -0800, Clint Byrum wrote: > I know thats what I'd want. I have one source server, that rsyncs the > same 3GB of random files to over 20 machines a few times a day. You have one source and many destinations. This looks to me like you want to use the batch options

Re: Where is my bottleneck?

2004-03-11 Thread Chuck Wolber
On Thu, 11 Mar 2004, Marc Abel wrote: > I don't expect 100 Mbit/s by any means, but 2? Is this typical? What > am I missing? Since it's on a local network segment, you probably don't need to waste the overhead that SSH provides you. In my tests, I was able to get 32 mb/s using plain rsync to th