Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
On Fri, 2 Jan 2015, Harry Putnam wrote: I'm pretty sure it would be faster over ssh but haven't tried that yet. Is this really abnormal? Can any of you give some idea what I should be expecting here? It is normal. NFS writes are synchronous writes. Unless your server has special provisions to make synchronous writes fast, there will be a significant slow-down. Doing rsync over SSH the other way around (pull from server) or over a SSH login on the server (push to server) will be primarility limited by the performance of the SSH encryption algorithm used. For my home-grown backup system, I have the server use ssh to access the system to be backed up, using rsync to transfer the data, and the transfer is efficient. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
If you're using rsync between computers over an existing secure link, then don't bother with the ssh overhead and set up an rsync-daemon and you'll get a much faster speed (and if you have riverbeds you even get optimisation) Jon On 3 January 2015 at 16:21, Bob Friesenhahn bfrie...@simple.dallas.tx.us wrote: On Fri, 2 Jan 2015, Harry Putnam wrote: I'm pretty sure it would be faster over ssh but haven't tried that yet. Is this really abnormal? Can any of you give some idea what I should be expecting here? It is normal. NFS writes are synchronous writes. Unless your server has special provisions to make synchronous writes fast, there will be a significant slow-down. Doing rsync over SSH the other way around (pull from server) or over a SSH login on the server (push to server) will be primarility limited by the performance of the SSH encryption algorithm used. For my home-grown backup system, I have the server use ssh to access the system to be backed up, using rsync to transfer the data, and the transfer is efficient. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
oops, you're Writing to the share, not reading from it; pls disregard and sorry for the misread. On Fri, Jan 2, 2015 at 11:10 PM, Jacob Ritorto jacob.rito...@gmail.com wrote: is it mounted with noatime? Updating access time for every file being read over nfs sometimes results in massive slowdown. An nfs rsync of millions of tiny files would exhibit this pathology. On Fri, Jan 2, 2015 at 10:48 PM, Harry Putnam rea...@newsguy.com wrote: Server setup: oi build 151_a9 zfs filesystem with nfs and root rw enabled on share. zfs get sharenfs p0/rrsnap/gv NAME PROPERTY VALUESOURCE p0/rrsnap/gv sharenfs rw=@192.168.0.0/24,root=@192.168.0.0/24 inherited from p0/rrsnap --- --- ---=--- --- --- client setup: Gentoo linux Linux gv 3.18.0-gentoo #3 SMP Sun Dec 14 13:29:08 EST 2014 i686 The linux client is running as vbox guest on OI b 151_a9 HOST --- --- ---=--- --- --- The rsync (in the form of an rsnapshot backup script) is being run on the Gentoo Linux OS and writing to the zfs share shown above. I see a major slowdown, maybe even a massive slowdown when writing to the nfs mounted share when compared to writing to an on client-HOST disc. It's running now, and so I can't give the completion time yet but I'm pretty sure it will be 4-5 times slower, so roughly 450 percent slower. Oh, and the amount of data being written is 1.3 GB I'll have both exact times at some point up ahead. I didn't think to time the on client-host run. I wasn't planning on changing to writting to an nfs share, but I can tell by watching the crawling output that it is orders of magnitude slower. I'm pretty sure it would be faster over ssh but haven't tried that yet. Is this really abnormal? Can any of you give some idea what I should be expecting here? ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
is it mounted with noatime? Updating access time for every file being read over nfs sometimes results in massive slowdown. An nfs rsync of millions of tiny files would exhibit this pathology. On Fri, Jan 2, 2015 at 10:48 PM, Harry Putnam rea...@newsguy.com wrote: Server setup: oi build 151_a9 zfs filesystem with nfs and root rw enabled on share. zfs get sharenfs p0/rrsnap/gv NAME PROPERTY VALUESOURCE p0/rrsnap/gv sharenfs rw=@192.168.0.0/24,root=@192.168.0.0/24 inherited from p0/rrsnap --- --- ---=--- --- --- client setup: Gentoo linux Linux gv 3.18.0-gentoo #3 SMP Sun Dec 14 13:29:08 EST 2014 i686 The linux client is running as vbox guest on OI b 151_a9 HOST --- --- ---=--- --- --- The rsync (in the form of an rsnapshot backup script) is being run on the Gentoo Linux OS and writing to the zfs share shown above. I see a major slowdown, maybe even a massive slowdown when writing to the nfs mounted share when compared to writing to an on client-HOST disc. It's running now, and so I can't give the completion time yet but I'm pretty sure it will be 4-5 times slower, so roughly 450 percent slower. Oh, and the amount of data being written is 1.3 GB I'll have both exact times at some point up ahead. I didn't think to time the on client-host run. I wasn't planning on changing to writting to an nfs share, but I can tell by watching the crawling output that it is orders of magnitude slower. I'm pretty sure it would be faster over ssh but haven't tried that yet. Is this really abnormal? Can any of you give some idea what I should be expecting here? ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
Server setup: oi build 151_a9 zfs filesystem with nfs and root rw enabled on share. zfs get sharenfs p0/rrsnap/gv NAME PROPERTY VALUESOURCE p0/rrsnap/gv sharenfs rw=@192.168.0.0/24,root=@192.168.0.0/24 inherited from p0/rrsnap --- --- ---=--- --- --- client setup: Gentoo linux Linux gv 3.18.0-gentoo #3 SMP Sun Dec 14 13:29:08 EST 2014 i686 The linux client is running as vbox guest on OI b 151_a9 HOST --- --- ---=--- --- --- The rsync (in the form of an rsnapshot backup script) is being run on the Gentoo Linux OS and writing to the zfs share shown above. I see a major slowdown, maybe even a massive slowdown when writing to the nfs mounted share when compared to writing to an on client-HOST disc. It's running now, and so I can't give the completion time yet but I'm pretty sure it will be 4-5 times slower, so roughly 450 percent slower. Oh, and the amount of data being written is 1.3 GB I'll have both exact times at some point up ahead. I didn't think to time the on client-host run. I wasn't planning on changing to writting to an nfs share, but I can tell by watching the crawling output that it is orders of magnitude slower. I'm pretty sure it would be faster over ssh but haven't tried that yet. Is this really abnormal? Can any of you give some idea what I should be expecting here? ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
Jacob Ritorto jacob.rito...@gmail.com writes: is it mounted with noatime? Updating access time for every file being read over nfs sometimes results in massive slowdown. An nfs rsync of millions of tiny files would exhibit this pathology. On Fri, Jan 2, 2015 at 10:48 PM, Harry Putnam rea...@newsguy.com wrote: OOps I forgot to show the mount on client (linux) side: grep /nfs/bk /etc/fstab 2x.local.lan:/rrsnap/gv /nfs/bk nfs4 defaults 0 0 The disc where the directory /nfs/bk lives, and the nfs share is mounted, does have noatime set. /dev/sda3/ext4 noatime 0 1 The backup includes /var/ so I guess the cache and maybe a few other places may have a goodly number of smallish files but I doubt it would number in the millions. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Should I see a major slowdown when rsyncing to zfs nfs share
Harry Putnam rea...@newsguy.com writes: Jacob Ritorto jacob.rito...@gmail.com writes: Sorry Jacob I didn't see your correction before replying ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
