Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Wed, 4 Feb 2009, Fajar A. Nugraha wrote: On Wed, Feb 4, 2009 at 1:28 AM, Bob Friesenhahn bfrie...@simple.dallas.tx.us wrote: On Tue, 3 Feb 2009, Fajar A. Nugraha wrote: Just wondering, why didn't you compress it first? something like zfs send | gzip backup.zfs.gz The 'lzop' compressor is much better for this since it is *much* faster. Sure, when enabling compression on zfs fs. Note that in the user's command line, the 'gzip' is changed to 'lzop'. It has nothing to do with ZFS. Of course change the file extention to something like .lzo. If the 'lzop' utility is not available, then it is necessary to install it. In my testing I found that lzop was *much* faster than gzip and the result was maybe 15% less compressed. It makes a huge difference when you are talking about a lot of data. Bob == Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
Hi Remco, isn't the ssh example used in a context where you immediately receive the stream (on another solaris system)? What I'm trying to do is storing a snapshot on another system or media (tape, dvd,...) and restoring it later. I know zfs send and receive are not ideal as a backup solution, but I would have thought that remotely storing snapshots wouldn't have been a problem. Regards, Niels -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
Niels, I do this all the time, to a USB connected external drive. And I have managed to restore a snapshot too :-) I don't see why you could mount an NFS mount from the service where you want to backup too. I wonder if windows does something bad to the file, is it larger then 2 Gb? ..Remco Niels Van Hee wrote: Hi Remco, isn't the ssh example used in a context where you immediately receive the stream (on another solaris system)? What I'm trying to do is storing a snapshot on another system or media (tape, dvd,...) and restoring it later. I know zfs send and receive are not ideal as a backup solution, but I would have thought that remotely storing snapshots wouldn't have been a problem. Regards, Niels ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
Hi Remco, the snapshots are indeed large files (just over 4gb). I haven't had problems copying tarballs over 2gb to this share however. I'll tar my home directory and try to copy that too to find out what happens :-) -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Tue, Feb 3, 2009 at 8:00 PM, Niels Van Hee nvan...@gmail.com wrote: Hi Remco, the snapshots are indeed large files (just over 4gb). Just wondering, why didn't you compress it first? something like zfs send | gzip backup.zfs.gz It should save lots of network bandwitdh. Plus, IF it does have something to do with file too large, compressing should help as a workaround. Regards, Fajar ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
Hi, Just wondering, why didn't you compress it first? I'm just trying out the basic zfs features on my home pc. I don't pay a lot of attentention to network bandwidth or compression at the moment.. And afaik, there's no issue with large files on OpenSolaris, I can copy a tarball of my home dir (over 4gb as well) to a windows share and untar it later without any problem. Or is a zfs send redirect that different? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Tue, 3 Feb 2009, Niels Van Hee wrote: the snapshots are indeed large files (just over 4gb). I haven't had problems copying tarballs over 2gb to this share however. I'll tar my home directory and try to copy that too to find out what happens Make sure that the unix shell you are using supports large files. Bob == Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Tue, 3 Feb 2009, Fajar A. Nugraha wrote: Just wondering, why didn't you compress it first? something like zfs send | gzip backup.zfs.gz It should save lots of network bandwitdh. Plus, IF it does have something to do with file too large, compressing should help as a workaround. The 'lzop' compressor is much better for this since it is *much* faster. Bob == Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Wed, Feb 4, 2009 at 1:28 AM, Bob Friesenhahn bfrie...@simple.dallas.tx.us wrote: On Tue, 3 Feb 2009, Fajar A. Nugraha wrote: Just wondering, why didn't you compress it first? something like zfs send | gzip backup.zfs.gz The 'lzop' compressor is much better for this since it is *much* faster. Sure, when enabling compression on zfs fs. I'm talking about compressing the zfs send stream. Last time I test, zfs send is always uncompressed regardless of fs compression setting. Thus, compressing it before writing to a file might be beneficial on certain situation. Regards, Fajar ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs send over sbmfs results in invalid record type on zfs receive
On Wed, Feb 4, 2009 at 10:41 AM, Fajar A. Nugraha fa...@fajar.net wrote: Just wondering, why didn't you compress it first? something like zfs send | gzip backup.zfs.gz The 'lzop' compressor is much better for this since it is *much* faster. Sure, when enabling compression on zfs fs. I thought you're refering to zfs compression algorithm where LZJB (default) is much faster. Seems that you're refereing to lzop to compress the zfs send stream. Sorry for the confusion. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss