Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Richard Elling For example, does 'zfs send -D' use the same DDT as the pool? No. Or does it require more memory for it's own DDT, thus impacting performance of both? Yes, no. How

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Lori Alt
On 09/ 6/11 11:45 PM, Daniel Carosone wrote: On Tue, Sep 06, 2011 at 10:05:54PM -0700, Richard Elling wrote: On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: For example, does 'zfs send -D' use the same DDT as the pool? No. My understanding was that 'zfs send -D' would use the pool's DDT in

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Freddie Cash
Thanks for the replies everyone. That was along the lines of what I was thinking (-D is a win for network usage savings, if it works) but wanted to double-check before I started playing with out new boxes. Will be interesting to see whether or not -D works with ZFSv28 in FreeBSD 8-STABLE/9-BETA.

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Daniel Carosone
On Wed, Sep 07, 2011 at 08:47:36AM -0600, Lori Alt wrote: On 09/ 6/11 11:45 PM, Daniel Carosone wrote: My understanding was that 'zfs send -D' would use the pool's DDT in building its own, if present. It does not use the pool's DDT, but it does use the SHA-256 checksums that have already

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Lori Alt
On 09/ 7/11 02:20 PM, Daniel Carosone wrote: On Wed, Sep 07, 2011 at 08:47:36AM -0600, Lori Alt wrote: On 09/ 6/11 11:45 PM, Daniel Carosone wrote: My understanding was that 'zfs send -D' would use the pool's DDT in building its own, if present. It does not use the pool's DDT, but it does use

Re: [zfs-discuss] zfs send and dedupe

2011-09-07 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Freddie Cash Will be interesting to see whether or not -D works with ZFSv28 in FreeBSD 8- STABLE/9-BETA. And whether or not zfs send is faster/better/easier/more reliable than rsyncing

[zfs-discuss] zfs send and dedupe

2011-09-06 Thread Freddie Cash
Just curious if anyone has looked into the relationship between zpool dedupe, zfs zend dedupe, memory use, and network throughput. For example, does 'zfs send -D' use the same DDT as the pool? Or does it require more memory for it's own DDT, thus impacting performance of both? If you have a

Re: [zfs-discuss] zfs send and dedupe

2011-09-06 Thread Richard Elling
On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: Just curious if anyone has looked into the relationship between zpool dedupe, zfs zend dedupe, memory use, and network throughput. Yes. For example, does 'zfs send -D' use the same DDT as the pool? No. Or does it require more memory for

Re: [zfs-discuss] zfs send and dedupe

2011-09-06 Thread Daniel Carosone
On Tue, Sep 06, 2011 at 10:05:54PM -0700, Richard Elling wrote: On Sep 6, 2011, at 9:01 PM, Freddie Cash wrote: For example, does 'zfs send -D' use the same DDT as the pool? No. My understanding was that 'zfs send -D' would use the pool's DDT in building its own, if present. If blocks