On Fri, Jan 9, 2009 at 11:41 PM, Brent Jones <br...@servuhome.net> wrote: > On Fri, Jan 9, 2009 at 7:53 PM, Ian Collins <i...@ianshome.com> wrote: >> Ian Collins wrote: >>> Send/receive speeds appear to be very data dependent. I have several >>> different filesystems containing differing data types. The slowest to >>> replicate is mail and my guess it's the changes to the index files that >>> takes the time. Similar sized filesystems with similar deltas where files >>> are mainly added or deleted appear to replicate faster. >>> >>> >> Has anyone investigated this? I have been replicating a server today >> and the differences between incremental processing is huge, for example: >> >> filesystem A: >> >> received 1.19Gb stream in 52 seconds (23.4Mb/sec) >> >> filesystem B: >> >> received 729Mb stream in 4564 seconds (164Kb/sec) >> >> I can delve further into the content if anyone is interested. >> >> -- >> Ian. >> >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss@opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >> > > What hardware, to/from is this? > > How are those filesystems laid out, what is their total size, used > space, and guessable file count / file size distribution? > > I'm also trying to put together the puzzle to provide more detail to a > case I opened with Sun regarding this. > > -- > Brent Jones > br...@servuhome.net >
Just to update this, hope no one is tired of hearing about it. I just image-updated to snv_105 to obtain patch for CR 6418042 at the recommendation from a Sun support technician. My results are much improved, on the order of 5-100 times faster (either over Mbuffer or SSH). Not only do snapshots begin sending right away (no longer requiring several minutes of reads before sending any data), the actual send will sustain about 35-50MB/sec over SSH, and up to 100MB/s via Mbuffer (on a single Gbit link, I am network limited now, something I never thought I would say I love to see!). Previously, I was lucky if the snapshot would begin sending any data after about 10 minutes, and once it did begin sending, it would usually peak at about 1MB/sec via SSH, and up to 20MB/sec over Mbuffer. Mbuffer seems to play a much larger role now, as SSH appears to only be single threaded for compression/encryption, peaking a single CPU worth of power. Mbuffers raw network performance saturates my Gigabit link, and making me consider link bonding or something to see how fast it -really- can go, now that the taps are open! So, my issues appears pretty much resolved, although snv_105 is in the /dev branch, things appear stable for the most part. Please let me know if you have any questions, or want additional info on my setup and testing. Regards, -- Brent Jones br...@servuhome.net _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
