[zfs-discuss] ZFS and very large directories

2006-08-24 Thread Patrick Narkinsky
Due to legacy constraints, I have a rather complicated system that is currently using Sun QFS (actually the SAM portion of it.) For a lot of reasons, I'd like to look at moving to ZFS, but would like a sanity check to make sure ZFS is suitable to this application. First of all, we are NOT

Re: [zfs-discuss] ZFS and very large directories

2006-08-24 Thread Noel Dellofano
ZFS actually uses the ZAP to handle directory lookups. The ZAP is not a btree but a specialized hash table where a hash for each directory entry is generated based on that entry's name. Hence you won't be doing any sort of linear search through the entire directory for a file, a hash is

Re: [zfs-discuss] ZFS and very large directories

2006-08-24 Thread Nicolas Williams
On Thu, Aug 24, 2006 at 10:46:27AM -0700, Noel Dellofano wrote: ZFS actually uses the ZAP to handle directory lookups. The ZAP is not a btree but a specialized hash table where a hash for each directory entry is generated based on that entry's name. Hence you won't be doing any sort of

Re: [zfs-discuss] ZFS and very large directories

2006-08-24 Thread Matthew Ahrens
On Thu, Aug 24, 2006 at 01:15:51PM -0500, Nicolas Williams wrote: I just tried creating 150,000 directories in a ZFS roto directory. It was speedy. Listing individual directories (lookup) is fast. Glad to hear that it's working well for you! Listing the large directory isn't, but that turns