Re: ZFS backups: retrieving a few files?

2010-11-24 Thread Alexander Leidinger
Quoting Peter Jeremy peterjer...@acm.org (from Wed, 24 Nov 2010 06:32:07 +1100): BTW, the entire export is performed at the current compression level - recompressing existing data. Are you sure the compression is done on the sending side, and not at the receiving side? I would expect the

Re: ZFS backups: retrieving a few files?

2010-11-24 Thread Peter Jeremy
On 2010-Nov-24 11:07:23 +0100, Alexander Leidinger alexan...@leidinger.net wrote: Quoting Peter Jeremy peterjer...@acm.org (from Wed, 24 Nov 2010 06:32:07 +1100): BTW, the entire export is performed at the current compression level - recompressing existing data. Are you sure the compression

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Andrew Reilly
On Mon, Nov 22, 2010 at 10:26:30AM -0500, Jonathan Stewart wrote: On 11/22/2010 6:35 AM, Andrew Reilly wrote: Dump/restore doesn't work for ZFS. I *think* that I'm running backups in the appropriate equivalent fashion: I take file system snapshots (both absolute == level 0) and relative

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Thomas Ronner
On 11/23/10 1:45 PM, Andrew Reilly wrote: No, I don't like tar, rsync and friends for backups: they don't deal well with hard links, special files or sparse files. rsync -avHxS --delete --numeric-ids /src/. /dst/. Handles sparse files (S) and hard links (H). Never had any trouble with

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Freddie Cash
On Tue, Nov 23, 2010 at 4:56 AM, Thomas Ronner tho...@ronner.org wrote: On 11/23/10 1:45 PM, Andrew Reilly wrote: No, I don't like tar, rsync and friends for backups: they don't deal well with hard links, special files or sparse files. rsync -avHxS --delete --numeric-ids /src/. /dst/.

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Thomas Ronner
On 11/23/10 4:45 PM, Freddie Cash wrote: On Tue, Nov 23, 2010 at 4:56 AM, Thomas Ronnertho...@ronner.org wrote: rsync -avHxS --delete --numeric-ids /src/. /dst/. One problem with using rsync when dealing with hard-linked files: it doesn't like it when the source switches from hard-linked

RE: ZFS backups: retrieving a few files?

2010-11-23 Thread Malcolm Waltz
would also fail if a bit flipped. -Original Message- From: owner-freebsd-sta...@freebsd.org [mailto:owner-freebsd-sta...@freebsd.org] On Behalf Of Andrew Reilly Sent: Tuesday, November 23, 2010 4:46 AM To: Jonathan Stewart Cc: sta...@freebsd.org Subject: Re: ZFS backups: retrieving a few

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Mike Tancsa
On 11/22/2010 8:29 PM, David Magda wrote: On Nov 22, 2010, at 17:13, Andrew Reilly wrote: The currently accepted practice is to create a ZFS file system on the backup drive and just keep sending incremental snapshots to it. As long as the backup drive and host system have a snapshot in

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread David Magda
On Tue, November 23, 2010 14:14, Mike Tancsa wrote: I am still trying to figure out the best way to do zfs backups locally here for rollbacks as well as DR. I was looking at some of the techniques at http://www.cuddletech.com/blog/pivot/entry.php?id=984 But thats outdated ? WRT errors in

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Peter Jeremy
On 2010-Nov-23 23:45:43 +1100, Andrew Reilly arei...@bigpond.net.au wrote: zfs send -vR tank/h...@0 | zfs receive -d /backup/snapshots in order to experiment with this strategy. One would then become alarmed when one discovered that the receive mechanism also invoked the mountpoint= parameter of

Re: ZFS backups: retrieving a few files?

2010-11-23 Thread Andrew Reilly
On Tue, Nov 23, 2010 at 01:56:01PM +0100, Thomas Ronner wrote: On 11/23/10 1:45 PM, Andrew Reilly wrote: No, I don't like tar, rsync and friends for backups: they don't deal well with hard links, special files or sparse files. rsync -avHxS --delete --numeric-ids /src/. /dst/. Handles

ZFS backups: retrieving a few files?

2010-11-22 Thread Andrew Reilly
Hi there, Being a cutting-edge hipster, my new personal server is using a ZFS RAIDZ array, where my older system used UFS on a GMIRROR. This is, by and large, a joy: ZFS rocks. One issue that I'm having difficulty coming to grips with, though, is that of backup. I used to do a weekly cycle

Re: ZFS backups: retrieving a few files?

2010-11-22 Thread Andriy Gapon
on 22/11/2010 13:35 Andrew Reilly said the following: The troubling aspect of this plan is that it would seem that grabbing just a few files would require space in the working zpool equivalent to the whole backed-up file system, for the zfs receive of the snapshot. Contrast this with restore,

Re: ZFS backups: retrieving a few files?

2010-11-22 Thread Jonathan Stewart
On 11/22/2010 6:35 AM, Andrew Reilly wrote: Dump/restore doesn't work for ZFS. I *think* that I'm running backups in the appropriate equivalent fashion: I take file system snapshots (both absolute == level 0) and relative (incremental), and zfs send those to files on the backup disk. This is

Re: ZFS backups: retrieving a few files?

2010-11-22 Thread Andrew Reilly
On Mon, Nov 22, 2010 at 10:26:30AM -0500, Jonathan Stewart wrote: On 11/22/2010 6:35 AM, Andrew Reilly wrote: Dump/restore doesn't work for ZFS. I *think* that I'm running backups in the appropriate equivalent fashion: I take file system snapshots (both absolute == level 0) and relative

Re: ZFS backups: retrieving a few files?

2010-11-22 Thread Jonathan
On 11/22/2010 5:13 PM, Andrew Reilly wrote: On Mon, Nov 22, 2010 at 10:26:30AM -0500, Jonathan Stewart wrote: On 11/22/2010 6:35 AM, Andrew Reilly wrote: Dump/restore doesn't work for ZFS. I *think* that I'm running backups in the appropriate equivalent fashion: I take file system snapshots

Re: ZFS backups: retrieving a few files?

2010-11-22 Thread David Magda
On Nov 22, 2010, at 17:13, Andrew Reilly wrote: The currently accepted practice is to create a ZFS file system on the backup drive and just keep sending incremental snapshots to it. As long as the backup drive and host system have a snapshot in common you can do incremental transfers.