Richard Jahnel wrote:
I've tried ssh blowfish and scp arcfour. both are CPU limited long before the
10g link is.
I'vw also tried mbuffer, but I get broken pipe errors part way through the
transfer.
Any idea why? Does the zfs send or zfs receive bomb out part way through?
Might be worth trying it over rsh if security isn't an issue, and then
you lose the encryption overhead. Trouble is that then you've got almost
no buffering, which can do bad things to the performance, which is why
mbuffer would be ideal if it worked for you.
I'm open to ideas for faster ways to to either zfs send directly or through a
compressed file of the zfs send output.
For the moment I;
zfs send > pigz
scp arcfour the file gz file to the remote host
gunzip < to zfs receive
This takes a very long time for 3 TB of data, and barely makes use the 10g
connection between the machines due to the CPU limiting on the scp and gunzip
processes.
Also, if you have multiple datasets to send, might be worth seeing if
sending them in parallel helps.
--
Andrew Gabriel
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
