[zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Gertjan Oude Lohuis
Filesystem are cheap is one of ZFS's mottos. I'm wondering how far this goes. Does anyone have experience with having more than 10.000 ZFS filesystems? I know that mounting this many filesystems during boot while take considerable time. Are there any other disadvantages that I should be aware of?

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Khushil Dep
The adage that I adhere to with ZFS features is just because you can doesn't mean you should!. I would suspect that with that many filesystems the normal zfs-tools would also take an inordinate length of time to complete their operations - scale according to size. Generally snapshots are quick

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Paul Kraus
On Tue, May 31, 2011 at 6:08 AM, Gertjan Oude Lohuis gert...@oudelohuis.nl wrote: Filesystem are cheap is one of ZFS's mottos. I'm wondering how far this goes. Does anyone have experience with having more than 10.000 ZFS filesystems? I know that mounting this many filesystems during boot

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Tomas Ögren
On 31 May, 2011 - Khushil Dep sent me these 4,5K bytes: The adage that I adhere to with ZFS features is just because you can doesn't mean you should!. I would suspect that with that many filesystems the normal zfs-tools would also take an inordinate length of time to complete their operations

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Jerry Kemp
Gertjan, In addition to the comments directly relating from your post, we have had similar discussions previously on the zfs-discuss list. If you care to go and review the list archives, I can share that we have had similar discussions on at least the following time periods. March 2006 May 2008

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Eric D. Mudama
On Tue, May 31 at 8:52, Paul Kraus wrote: When we initially configured a large (20TB) files server about 5 years ago, we went with multiple zpools and multiple datasets (zfs) in each zpool. Currently we have 17 zpools and about 280 datasets. Nowhere near the 10,000+ you intend. We are moving

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Matthew Ahrens
On Tue, May 31, 2011 at 6:52 AM, Tomas Ögren st...@acc.umu.se wrote: On a different setup, we have about 750 datasets where we would like to use a single recursive snapshot, but when doing that all file access will be frozen for varying amounts of time (sometimes half an hour or way more).

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Gertjan Oude Lohuis
On 05/31/2011 03:52 PM, Tomas Ögren wrote: I've done a not too scientific test on reboot times for Solaris 10 vs 11 with regard to many filesystems... http://www8.cs.umu.se/~stric/tmp/zfs-many.png As the picture shows, don't try 1 filesystems with nfs on sol10. Creating more filesystems

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Gertjan Oude Lohuis
On 05/31/2011 12:26 PM, Khushil Dep wrote: Generally snapshots are quick operations but 10,000 such operations would I believe take enough to time to complete as to present operational issues - breaking these into sets would alleviate some? Perhaps if you are starting to run into many thousands

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Richard Elling
On May 31, 2011, at 2:29 PM, Gertjan Oude Lohuis wrote: On 05/31/2011 03:52 PM, Tomas Ögren wrote: I've done a not too scientific test on reboot times for Solaris 10 vs 11 with regard to many filesystems... http://www8.cs.umu.se/~stric/tmp/zfs-many.png As the picture shows, don't try

Re: [zfs-discuss] Experiences with 10.000+ filesystems

2011-05-31 Thread Tomas Ögren
On 31 May, 2011 - Gertjan Oude Lohuis sent me these 0,9K bytes: On 05/31/2011 03:52 PM, Tomas Ögren wrote: I've done a not too scientific test on reboot times for Solaris 10 vs 11 with regard to many filesystems... http://www8.cs.umu.se/~stric/tmp/zfs-many.png As the picture shows, don't