Re: [zfs-discuss] ZFS send/receive questions
Will Murnane wrote: On Thu, Jul 10, 2008 at 12:43, Glaser, David [EMAIL PROTECTED] wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. On receiving machine: nc -l 12345 | zfs recv mypool/[EMAIL PROTECTED] and on sending machine: zfs send sourcepool/[EMAIL PROTECTED] | nc othermachine.umich.edu 12345 You'll need to build your own netcat, but this is fairly simple. If Why ? Pathname: /usr/bin/nc Type: regular file Expected mode: 0555 Expected owner: root Expected group: bin Expected file size (bytes): 31428 Expected sum(1) of contents: 5207 Expected last modification: Jun 16 05:58:18 2008 Referenced by the following packages: SUNWnetcat Current status: installed -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Fri, Jul 11, 2008 at 05:23, Darren J Moffat [EMAIL PROTECTED] wrote: Why ? Referenced by the following packages: SUNWnetcat Is this in 10u5? Weird, it's not on my media. Will ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Will Murnane wrote: On Fri, Jul 11, 2008 at 05:23, Darren J Moffat [EMAIL PROTECTED] wrote: Why ? Referenced by the following packages: SUNWnetcat Is this in 10u5? Weird, it's not on my media. No but this is an opensolaris.org alias not a Solaris 10 support forum. So the assumption unless people say otherwise is that you are running a recent build of SX:CE or OpenSolaris 2008.05 (including updates). -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Fri, Jul 11, 2008 at 11:44, Darren J Moffat [EMAIL PROTECTED] wrote: No but this is an opensolaris.org alias not a Solaris 10 support forum. So the assumption unless people say otherwise is that you are running a recent build of SX:CE or OpenSolaris 2008.05 (including updates). Luckily, the OP mentioned he's running 10u5 in his first post ;) Will ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] ZFS send/receive questions
Hi all, I'm a little (ok, a lot) confused on the whole zfs send/receive commands. I've seen mention of using zfs send between two different machines, but no good howto in order to make it work. I have one try-n-buy x4500 that we are trying to move data from onto a new x4500 that we've purchased. Right now I'm using rsync over ssh (via 1GB/s network) to copy the data but it is almost painfully slow (700GB over 24 hours). Yeah, it's a load of small files for the most part. Anyway, would zfs send/receive work better? Do you have to set up a service on the receiving machine in order to receive the zfs stream? The machine is an x4500 running Solaris 10 u5. Thanks Dave David Glaser Systems Administrator LSA Information Technology University of Michigan ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Glaser, David wrote: Hi all, I'm a little (ok, a lot) confused on the whole zfs send/receive commands. I've seen mention of using zfs send between two different machines, but no good howto in order to make it work. zfs(1) man page, Examples 12 and 13 show how to use senn/receive with ssh. What isn't clear about them ? Do you have to set up a service on the receiving machine in order to receive the zfs stream? No. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Thu, 10 Jul 2008, Glaser, David wrote: x4500 that we've purchased. Right now I'm using rsync over ssh (via 1GB/s network) to copy the data but it is almost painfully slow (700GB over 24 hours). Yeah, it's a load of small files for the most part. Anyway, would zfs send/receive work better? Do you have to set up a service on the receiving machine in order to receive the zfs stream? You don't need to set up a service on the remote machine. You can use ssh to invoke the zfs receive and pipe the data across the ssh connection, which is similar to what rsync is doing. For example (from the zfs docs): zfs send tank/[EMAIL PROTECTED] | ssh newsys zfs recv sandbox/[EMAIL PROTECTED] For a fresh copy, the bottleneck is quite likely ssh itself. Ssh uses fancy encryption algorithms which take lots of CPU time and really slows things down. The blowfish algorithm seems to be fastest so passing -c blowfish As an ssh option can significantly speed things up. For example, this is how you can tell rsync to use ssh with your own options: --rsh='/usr/bin/ssh -c blowfish' In order to achieve even more performance (but without encryption), you can use Netcat as the underlying transport. See http://netcat.sourceforge.net/. Lastly, if you have much more CPU available than bandwidth, then it is worthwhile to install and use the 'lzop' compression program which compresses very quickly to a format only about 30% less compressed than what gzip achieves but fast enough for real-time data transmission. It is easy to insert lzop into the pipeline so that less data is sent across the network. Bob == Bob Friesenhahn [EMAIL PROTECTED], http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Thu, Jul 10, 2008 at 09:02:35AM -0700, Tim Spriggs wrote: zfs(1) man page, Examples 12 and 13 show how to use senn/receive with ssh. What isn't clear about them ? I found that the overhead of SSH really hampered my ability to transfer data between thumpers as well. When I simply ran a set of sockets and a pipe things went much faster (filled a 1G link). Essentially I used netcat instead of SSH. You can use blowfish [0] or arcfour [1] as they are faster than the default algorithm (3des). Cheers, florin 0: ssh(1) man page 1: http://www.psc.edu/networking/projects/hpn-ssh/theory.php -- Bruce Schneier expects the Spanish Inquisition. http://geekz.co.uk/schneierfacts/fact/163 pgpvZKLQ7qBAI.pgp Description: PGP signature ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Florin Iucha wrote: On Thu, Jul 10, 2008 at 09:02:35AM -0700, Tim Spriggs wrote: zfs(1) man page, Examples 12 and 13 show how to use senn/receive with ssh. What isn't clear about them ? I found that the overhead of SSH really hampered my ability to transfer data between thumpers as well. When I simply ran a set of sockets and a pipe things went much faster (filled a 1G link). Essentially I used netcat instead of SSH. You can use blowfish [0] or arcfour [1] as they are faster than the default algorithm (3des). The default algorithm for ssh on Solaris is not 3des it is aes128-ctr. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Is that faster than blowfish? Dave -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Darren J Moffat Sent: Thursday, July 10, 2008 12:27 PM To: Florin Iucha Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] ZFS send/receive questions Florin Iucha wrote: On Thu, Jul 10, 2008 at 09:02:35AM -0700, Tim Spriggs wrote: zfs(1) man page, Examples 12 and 13 show how to use senn/receive with ssh. What isn't clear about them ? I found that the overhead of SSH really hampered my ability to transfer data between thumpers as well. When I simply ran a set of sockets and a pipe things went much faster (filled a 1G link). Essentially I used netcat instead of SSH. You can use blowfish [0] or arcfour [1] as they are faster than the default algorithm (3des). The default algorithm for ssh on Solaris is not 3des it is aes128-ctr. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
I guess what I was wondering if there was a direct method rather than the overhead of ssh. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Darren J Moffat Sent: Thursday, July 10, 2008 11:40 AM To: Glaser, David Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] ZFS send/receive questions Glaser, David wrote: Hi all, I'm a little (ok, a lot) confused on the whole zfs send/receive commands. I've seen mention of using zfs send between two different machines, but no good howto in order to make it work. zfs(1) man page, Examples 12 and 13 show how to use senn/receive with ssh. What isn't clear about them ? Do you have to set up a service on the receiving machine in order to receive the zfs stream? No. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Glaser, David wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. As others have suggested use netcat (/usr/bin/nc) however you get no over the wire data confidentiality or integrity and no strong authentication with that. If you need those then a combination of netcat and IPsec might help. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Thankfully right now it's between a private IP network between the two machines. I'll play with it a bit and let folks know if I can't get it to work. Thanks, Dave -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Darren J Moffat Sent: Thursday, July 10, 2008 12:50 PM To: Glaser, David Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] ZFS send/receive questions Glaser, David wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. As others have suggested use netcat (/usr/bin/nc) however you get no over the wire data confidentiality or integrity and no strong authentication with that. If you need those then a combination of netcat and IPsec might help. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Thu, Jul 10, 2008 at 12:43, Glaser, David [EMAIL PROTECTED] wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. On receiving machine: nc -l 12345 | zfs recv mypool/[EMAIL PROTECTED] and on sending machine: zfs send sourcepool/[EMAIL PROTECTED] | nc othermachine.umich.edu 12345 You'll need to build your own netcat, but this is fairly simple. If you run into trouble let me know and I'll post an x86 package. Will ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Could I trouble you for the x86 package? I don't seem to have much in the way of software on this try-n-buy system... Thanks, Dave -Original Message- From: Will Murnane [mailto:[EMAIL PROTECTED] Sent: Thursday, July 10, 2008 12:58 PM To: Glaser, David Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] ZFS send/receive questions On Thu, Jul 10, 2008 at 12:43, Glaser, David [EMAIL PROTECTED] wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. On receiving machine: nc -l 12345 | zfs recv mypool/[EMAIL PROTECTED] and on sending machine: zfs send sourcepool/[EMAIL PROTECTED] | nc othermachine.umich.edu 12345 You'll need to build your own netcat, but this is fairly simple. If you run into trouble let me know and I'll post an x86 package. Will ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
Will Murnane wrote: On Thu, Jul 10, 2008 at 12:43, Glaser, David [EMAIL PROTECTED] wrote: I guess what I was wondering if there was a direct method rather than the overhead of ssh. On receiving machine: nc -l 12345 | zfs recv mypool/[EMAIL PROTECTED] and on sending machine: zfs send sourcepool/[EMAIL PROTECTED] | nc othermachine.umich.edu 12345 You'll need to build your own netcat, but this is fairly simple. If you run into trouble let me know and I'll post an x86 package. Will If you are running Nexenta you can also apt-get install sunwnetcat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS send/receive questions
On Thu, Jul 10, 2008 at 13:05, Glaser, David [EMAIL PROTECTED] wrote: Could I trouble you for the x86 package? I don't seem to have much in the way of software on this try-n-buy system... No problem. Packages are posted at http://will.incorrige.us/solaris-packages/ . You'll need gettext and iconv as well as netcat, as it links against libiconv. Download the gzip files, decompress them with gzip -d, then pkgtrans $packagefile $tempdir and run pkgadd -d $tempdir. Files will be installed in the /usr/site hierarchy. The executable is called netcat, not nc, because that's what it builds as by default. I believe I got all the dependencies, but if not I'll be glad to post whatever is missing as well. If you'd rather have spec files and sources (which you can assemble with pkgbuild) than binaries, I can provide those instead. Will ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
