Rob Latham wrote:
are you transferring locally, like to an external hard drive?
rsync's -W (whole file) option says this:
This [-W] is the default when both the source and destination
are specified as local paths, but only if no batch-writing option
is in effect.
Does the '--no-whole-file' option help at all?
==rob
I haven't tried that option, but the rsync is a remote rsync over ssh,
between two separate hosts.
When I was still running it with the --progress option, it was clearly
indicating that it was doing partial file transfers.
I ran rsync with the --stats option to get a bit more detail, and here
it is:
Number of files: 429
Number of files transferred: 27
Total file size: 17242186574 bytes
Total transferred file size: 284497273 bytes
Literal data: 6386759 bytes
Matched data: 278246448 bytes
File list size: 9254
File list generation time: 0.050 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 501086
Total bytes received: 5616588
So it looks like, in that particular instance, 6MB of 271MB was
compressed down to ~5MB and transferred. I think I'm going to leave
that option on for a while just to see how the literal/matched/received
byte counts change over time.
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
