Re: [zfs-discuss] ZFS send | verify | receive

2009-12-07 Thread sgheeren
Edward Ned Harvey wrote: I use the excellent pbzip2 zfs send ... | tee (md5sum) | pbzip2 | ssh remote ... Utilizes those 8 cores quite well :) This (pbzip2) sounds promising, and it must be better than what I wrote. ;-) But I don't understand the syntax you've got above, using

Re: [zfs-discuss] file concatenation with ZFS copy-on-write

2009-12-04 Thread sgheeren
Darren J Moffat wrote: Per Baatrup wrote: I would like to to concatenate N files into one big file taking advantage of ZFS copy-on-write semantics so that the file concatenation is done without actually copying any (large amount of) file content. cat f1 f2 f3 f4 f5 f15 Is this already

Re: [zfs-discuss] file concatenation with ZFS copy-on-write

2009-12-04 Thread sgheeren
Per Baatrup wrote: I would like to to concatenate N files into one big file taking advantage of ZFS copy-on-write semantics so that the file concatenation is done without actually copying any (large amount of) file content. cat f1 f2 f3 f4 f5 f15 Is this already possible when source and

Re: [zfs-discuss] file concatenation with ZFS copy-on-write

2009-12-04 Thread sgheeren
After reading all the comments it appears that there may be a 'real' problem with unaligned block sizes that DEDUP simply will not handle. What you seem to be after, then, is the opposite of sparse files, 'virtual files' that can be chained together as a linked list of _fragments_ of