On Wed 07/01/09 20:31 , Carsten Aulbert carsten.aulb...@aei.mpg.de sent: > Brent Jones wrote: > > > > Using mbuffer can speed it up dramatically, but > > this seems like a hack> without addressing a real problem with zfs > > send/recv.> Trying to send any meaningful sized snapshots > > from say an X4540 takes> up to 24 hours, for as little as 300GB > > changerate.
> I have not found a solution yet also. But it seems to depend highly on > the distribution of file sizes, number of files per directory or > whatever. The last tests I made showed still more than 50 hours for 700 > GB and ~45 hours for 5 TB (both tests were null tests where zfs send > wrote to /dev/null). Send/receive speeds appear to be very data dependent. I have several different filesystems containing differing data types. The slowest to replicate is mail and my guess it's the changes to the index files that takes the time. Similar sized filesystems with similar deltas where files are mainly added or deleted appear to replicate faster. Cutting out ssh (I use direct socket connections and large circular buffers) makes more of a difference for full sends (doubled the throughput between Thumpers). The improvement to incrementals varies. Data gets sent over the wire quickly, but the receive can still take a long time. Ian. _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
