Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-06 Thread Kjetil Torgrim Homme
Frank Cusack frank+lists/z...@linetwo.net writes: On 2/4/10 8:00 AM +0100 Tomas Ögren wrote: The find -newer blah suggested in other posts won't catch newer files with an old timestamp (which could happen for various reasons, like being copied with kept timestamps from somewhere else). good

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-05 Thread Jesus Cea
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/03/2010 04:35 PM, Andrey Kuzmin wrote: At zfs_send level there are no files, just DMU objects (modified in some txg which is the basis for changed/unchanged decision). Would be awesome if zfs send would have an option to show files changed

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-05 Thread Jesus Cea
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/04/2010 05:10 AM, Matthew Ahrens wrote: This is RFE 6425091 want 'zfs diff' to list files that have changed between snapshots, which covers both file directory changes, and file removal/creation/renaming. We actually have a prototype of zfs

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Henu
So do you mean I cannot gather the names and locations of changed/created/removed files just by analyzing a stream of (incremental) zfs_send? Quoting Andrey Kuzmin andrey.v.kuz...@gmail.com: On Wed, Feb 3, 2010 at 6:11 PM, Ross Walker rswwal...@gmail.com wrote: On Feb 3, 2010, at 9:53 AM,

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Henu
Whoa! That is exactly what I've been looking for. Is there any developement version publicly available for testing? Regards, Henrik Heino Quoting Matthew Ahrens matthew.ahr...@sun.com: This is RFE 6425091 want 'zfs diff' to list files that have changed between snapshots, which covers both

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Ian Collins
Henu wrote: So do you mean I cannot gather the names and locations of changed/created/removed files just by analyzing a stream of (incremental) zfs_send? That's correct, you can't. Snapshots do not work at the file level. -- Ian. ___ zfs-discuss

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Darren Mackay
Hi Ross, zdb - f...@snapshot | grep path | nawk '{print $2}' Enjoy! Darren Mackay -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Darren Mackay
looking through some more code.. i was a bit premature in my last post - been a long day. extracting the guids and query the metadata seems to be logical - i think runnign a zfs send just to parse the data stream is a lot of overhead, when you really only need to traverse metadata directly.

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Ross Walker
On Feb 4, 2010, at 2:00 AM, Tomas Ögren st...@acc.umu.se wrote: On 03 February, 2010 - Frank Cusack sent me these 0,7K bytes: On February 3, 2010 12:04:07 PM +0200 Henu henrik.he...@tut.fi wrote: Is there a possibility to get a list of changed files between two snapshots? Currently I do

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Darren Mackay
The delete queue and related blocks need further investigation... r...@osol-dev:/data/zdb-test# zdb -dd data/zdb-test | more Dataset data/zdb-test [ZPL], ID 641, cr_txg 529804, 24.5K, 6 objects Object lvl iblk dblk dsize lsize %full type 0716K16K 15.0K16K

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Frank Cusack
On 2/4/10 8:00 AM +0100 Tomas Ögren wrote: rsync by default compares metadata first, and only checks through every byte if you add the -c (checksum) flag. I would say rsync is the best tool here. ah, i didn't know that was the default. no wonder recently when i was incremental-rsyncing a few

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Frank Cusack
On 2/4/10 8:21 AM -0500 Ross Walker wrote: Find -newer doesn't catch files added or removed it assumes identical trees. This may be redundant in light of my earlier post, but yes it does. Directory mtimes are updated when a file is added or removed, and find -newer will detect that. -frank

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-04 Thread Darren Mackay
Hi Ross, Yes - zdb - is dumping out info in the form of: Object lvl iblk dblk dsize lsize %full type 19116K512512512 100.00 ZFS plain file 264 bonus ZFS znode dnode flags: USED_BYTES

[zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Henu
Hello Is there a possibility to get a list of changed files between two snapshots? Currently I do this manually, using basic file system functions offered by OS. I scan every byte in every file manually and it is of course awfully slow. If I have understood correctly, ZFS could use its

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Henu
Okay, so first of all, it's true that send is always fast and 100% reliable because it uses blocks to see differences. Good, and thanks for this information. If everything else fails, I can parse the information I want from send stream :) But am I right, that there is no other methods to

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Ross Walker
On Feb 3, 2010, at 9:53 AM, Henu henrik.he...@tut.fi wrote: Okay, so first of all, it's true that send is always fast and 100% reliable because it uses blocks to see differences. Good, and thanks for this information. If everything else fails, I can parse the information I want from send

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Frank Cusack
On February 3, 2010 12:04:07 PM +0200 Henu henrik.he...@tut.fi wrote: Is there a possibility to get a list of changed files between two snapshots? Great timing as I just looked this up last night, I wanted to verify that an install program was only changing the files on disk that it claimed to

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Frank Cusack
On February 3, 2010 12:04:07 PM +0200 Henu henrik.he...@tut.fi wrote: Is there a possibility to get a list of changed files between two snapshots? Currently I do this manually, using basic file system functions offered by OS. I scan every byte in every file manually and it

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Andrey Kuzmin
On Wed, Feb 3, 2010 at 6:11 PM, Ross Walker rswwal...@gmail.com wrote: On Feb 3, 2010, at 9:53 AM, Henu henrik.he...@tut.fi wrote: Okay, so first of all, it's true that send is always fast and 100% reliable because it uses blocks to see differences. Good, and thanks for this information. If

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Jens Elkner
On Wed, Feb 03, 2010 at 10:29:18AM -0500, Frank Cusack wrote: On February 3, 2010 12:04:07 PM +0200 Henu henrik.he...@tut.fi wrote: Is there a possibility to get a list of changed files between two snapshots? Great timing as I just looked this up last night, I wanted to verify that an

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Frank Cusack
On February 3, 2010 6:02:52 PM +0100 Jens Elkner jel+...@cs.uni-magdeburg.de wrote: On Wed, Feb 03, 2010 at 10:29:18AM -0500, Frank Cusack wrote: # newer files find /file/system -newer /file/system/.zfs/snapshot/snapname -type f # deleted files cd /file/system/.zfs/snapshot/snapname find .

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Frank Cusack
On February 3, 2010 12:19:50 PM -0500 Frank Cusack frank+lists/z...@linetwo.net wrote: If you do need to know about deleted files, the find method still may be faster depending on how ddiff determines whether or not to do a file diff. The docs don't explain the heuristics so I wouldn't want to

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Jens Elkner
On Wed, Feb 03, 2010 at 12:19:50PM -0500, Frank Cusack wrote: On February 3, 2010 6:02:52 PM +0100 Jens Elkner jel+...@cs.uni-magdeburg.de wrote: On Wed, Feb 03, 2010 at 10:29:18AM -0500, Frank Cusack wrote: # newer files find /file/system -newer /file/system/.zfs/snapshot/snapname -type f

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Ross Walker
On Feb 3, 2010, at 12:35 PM, Frank Cusack frank+lists/ z...@linetwo.net wrote: On February 3, 2010 12:19:50 PM -0500 Frank Cusack frank+lists/z...@linetwo.net wrote: If you do need to know about deleted files, the find method still may be faster depending on how ddiff determines whether or

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Richard Elling
On Feb 3, 2010, at 3:46 PM, Ross Walker wrote: On Feb 3, 2010, at 12:35 PM, Frank Cusack frank+lists/z...@linetwo.net wrote: On February 3, 2010 12:19:50 PM -0500 Frank Cusack frank+lists/z...@linetwo.net wrote: If you do need to know about deleted files, the find method still may be

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Matthew Ahrens
This is RFE 6425091 want 'zfs diff' to list files that have changed between snapshots, which covers both file directory changes, and file removal/creation/renaming. We actually have a prototype of zfs diff. Hopefully someday we will finish it up... --matt Henu wrote: Hello Is there a

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Ross Walker
On Feb 3, 2010, at 8:59 PM, Frank Cusack frank+lists/z...@linetwo.net wrote: On February 3, 2010 6:46:57 PM -0500 Ross Walker rswwal...@gmail.com wrote: So was there a final consensus on the best way to find the difference between two snapshots (files/directories added, files/directories

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Jens Elkner
On Wed, Feb 03, 2010 at 06:46:57PM -0500, Ross Walker wrote: On Feb 3, 2010, at 12:35 PM, Frank Cusack frank+lists/ z...@linetwo.net wrote: On February 3, 2010 12:19:50 PM -0500 Frank Cusack frank+lists/z...@linetwo.net wrote: If you do need to know about deleted files, the find method

Re: [zfs-discuss] How to get a list of changed files between two snapshots?

2010-02-03 Thread Tomas Ögren
On 03 February, 2010 - Frank Cusack sent me these 0,7K bytes: On February 3, 2010 12:04:07 PM +0200 Henu henrik.he...@tut.fi wrote: Is there a possibility to get a list of changed files between two snapshots? Currently I do this manually, using basic file system functions offered by OS. I