In testing 3.0.0pre1 and now 3.0.0pre2 I have noticed that the rate
of data transfer is ~25% slower than 2.6.9. I am using rsync to
mirror 2 filesystems from a single host. On average for large files
( 4gb) under 3.0.0pre2 the transfer of ~75MB/sec. WIth 2.6.9 the
average is
level
directory move with lots of files and data underneath. I recall
someone else was asking about this on the list.
Greg
On Oct 12, 2007, at 6:43 PM, Matt McCutchen wrote:
On 10/12/07, Greg Siekas [EMAIL PROTECTED] wrote:
The other option I thought of was to only do the move when
Is it possible to disable checksumming? I'm using rsync with -W,
whole file, so if a file has changed I don't want to just transfer the
changes. The source and destination or local filesystems.
I've noticed that performance in 3.0.6 is slower than 2.6.9. 3.0.6 is
at ~90MB/sec and 2.6.9 is
Wayne,
Transferring an 8gb file using rsync between a network (10GbE) mounted
filesystem and local disk.
rsync-2.6.9 - 88-95 MB/sec
rsync-3.0.6 - 62-72 MB/sec
rsync-3.1.0 - 86-90 MB/sec
Doing a cp of the file yields 140-160MB/sec.
It appears the IO code improvements in 3.1 have definitely
Has anyone compiled rsync with other newer compilers like Intel 11.1? Does
this break anything?
My quick test shows rsync-3.1.0 performance jumps to ~120MB/sec.
Greg
On Nov 13, 2009, at 10:44 AM, Greg Siekas wrote:
Wayne,
Transferring an 8gb file using rsync between a network (10GbE
I'm curious as to why IO_BUFFER_SIZE is only set to 4092 in rsync.h? This
seems very small. Is there any harm in increasing it? If not, what is the
proper way to determine what is should be set to?
Greg
--
Please use reply-all for most replies to avoid omitting the mailing list.
To
40 files a second seems very slow. Are you sure the majority of the time is
generating the file list and determine what's changed? How many of the
millions of files are changed?
On modern hardware I see 1000's of files per second when scanning for changed
files.
On Jun 6, 2011, at 12:39
With the SSH-HPN you can achieve over 200MB/sec. Depends on your latency and
packet drops but you should certainly try a modified ssh/scp with rsync. Also
are you using compression with rsync -z? That's an area that could be multi
threaded.
On Jan 20, 2013, at 3:25 PM, Kevin Korb
