Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-12 Thread Jürgen Keil
The problem was with the shell. For whatever reason, /usr/bin/ksh can't rejoin the files correctly. When I switched to /sbin/sh, the rejoin worked fine, the cksum's matched, ... The ksh I was using is: # what /usr/bin/ksh /usr/bin/ksh: Version M-11/16/88i SunOS 5.10 Generic

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-11 Thread Michael McKnight
Thanks to John K. and Richard E. for an answer that would have never, ever occurred to me... The problem was with the shell. For whatever reason, /usr/bin/ksh can't rejoin the files correctly. When I switched to /sbin/sh, the rejoin worked fine, the cksum's matched, and the zfs recv worked

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-10 Thread Michael McKnight
Hi again everyone, OK... I'm even more confused at what is happening here when I try to rejoin the split zfs send file... When I cat the split files and pipe through cksum, I get the same cksum as the original (unsplit) zfs send snapshot: #cat mypictures.zfssnap.split.a[a-d] |cksum

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-06 Thread Miles Nordin
re == Richard Elling richard.ell...@gmail.com writes: re The reason is that zfs send/recv has very good application, re even in the backup space. There are, in fact, many people re using it. [...] re ZFS send is not an archival solution. You should use an re archival

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-06 Thread Richard Elling
my last contribution to this thread (and there was much rejoicing!) Miles Nordin wrote: re == Richard Elling richard.ell...@gmail.com writes: re The reason is that zfs send/recv has very good application, re even in the backup space. There are, in fact, many people

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread Joerg Schilling
Miles Nordin car...@ivy.net wrote: tt == Toby Thain t...@telegraphics.com.au writes: tt I know this was discussed a while back, but in what sense does tt tar do any of those things? I understand that it is unlikely tt to barf completely on bitflips, but won't tar simply silently

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread CLF
I use the following command to convert them back into a single file: #cat mypictures.zfssnap.split.a[a-g] testjoin Maybe I'm missing the point, but this command won't give you what you're after - in bash you want: # cat mypictures.zfssnap.split.a{a..g} testjoin Chris

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread Casper . Dik
I use the following command to convert them back into a single file: #cat mypictures.zfssnap.split.a[a-g] testjoin Maybe I'm missing the point, but this command won't give you what you're after - in bash you want: # cat mypictures.zfssnap.split.a{a..g} testjoin The first should work

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread David Dyer-Bennet
On Thu, February 5, 2009 06:39, casper@sun.com wrote: I use the following command to convert them back into a single file: #cat mypictures.zfssnap.split.a[a-g] testjoin Maybe I'm missing the point, but this command won't give you what you're after - in bash you want: # cat

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread Miles Nordin
re == Richard Elling richard.ell...@gmail.com writes: re Indeed, but perhaps you'll find the grace to file an re appropriate RFE? for what? The main problem I saw was with the wiki not warning people away from archiving 'zfs send' emphatically enough, for example by comparing its

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread Michael McKnight
Hi everyone, I appreciate the discussion on the practicality of archiving ZFS sends, but right now I don't know of any other options. I'm a home user, so Enterprise-level solutions aren't available and as far as I know, tar, cpio, etc. don't capture ACL's and other low-level filesystem

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread David Dyer-Bennet
On Thu, February 5, 2009 14:15, Michael McKnight wrote: I appreciate the discussion on the practicality of archiving ZFS sends, but right now I don't know of any other options. I'm a home user, so Enterprise-level solutions aren't available and as far as I know, tar, cpio, etc. don't

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-05 Thread Miles Nordin
mm == Michael McKnight michael_mcknigh...@yahoo.com writes: mm as far as I know, tar, cpio, etc. don't capture ACL's and mm other low-level filesystem attributes. Take another look with whatever specific ACL's you're using. Some of the cpio formats will probably work because I think

[zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Michael McKnight
Hello everyone, I am trying to take ZFS snapshots (ie. zfs send) and burn them to DVD's for offsite storage. In many cases, the snapshots greatly exceed the 8GB I can stuff onto a single DVD-DL. In order to make this work, I have used the split utility to break the images into smaller,

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Toby Thain
On 4-Feb-09, at 6:19 AM, Michael McKnight wrote: Hello everyone, I am trying to take ZFS snapshots (ie. zfs send) and burn them to DVD's for offsite storage. In many cases, the snapshots greatly exceed the 8GB I can stuff onto a single DVD-DL. In order to make this work, I have used

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Miles Nordin
mm == Michael McKnight michael_mcknigh...@yahoo.com writes: mm #split -b8100m ./mypictures.zfssnap mypictures.zfssnap.split. mm #cat mypictures.zfssnap.split.a[a-g] testjoin mm But when I compare the checksum of the original snapshot to mm that of the rejoined snapshot, I get a

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread David Dyer-Bennet
On Wed, February 4, 2009 12:01, Miles Nordin wrote: * stream format is not guaranteed to be forward compatible with new kernels. and versioning may be pickier than zfs/zpool versions. Useful points, all of them. This particular one also points out something I hadn't previously thought

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Bob Friesenhahn
On Wed, 4 Feb 2009, Toby Thain wrote: In order to make this work, I have used the split utility ... I use the following command to convert them back into a single file: #cat mypictures.zfssnap.split.a[a-g] testjoin But when I compare the checksum of the original snapshot to that of the

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Toby Thain
On 4-Feb-09, at 2:29 PM, Bob Friesenhahn wrote: On Wed, 4 Feb 2009, Toby Thain wrote: In order to make this work, I have used the split utility ... I use the following command to convert them back into a single file: #cat mypictures.zfssnap.split.a[a-g] testjoin But when I compare the

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Miles Nordin
tt == Toby Thain t...@telegraphics.com.au writes: tt I know this was discussed a while back, but in what sense does tt tar do any of those things? I understand that it is unlikely tt to barf completely on bitflips, but won't tar simply silently tt de-archive bad data? yeah, I

Re: [zfs-discuss] ZFS snapshot splitting joining

2009-02-04 Thread Richard Elling
Miles Nordin wrote: mm == Michael McKnight michael_mcknigh...@yahoo.com writes: mm #split -b8100m ./mypictures.zfssnap mypictures.zfssnap.split. mm #cat mypictures.zfssnap.split.a[a-g] testjoin mm But when I compare the checksum of the original snapshot to mm