Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Tue, Mar 02, 2010 at 03:14:04PM -0800, Richard Elling wrote: > That is just a shorthand for snapshotting (snapshooting? :-) datasets. :-) > There still is no pool snapshot feature. One could pick nits about "zpool split" .. -- Dan. pgppVa56AxgBa.pgp Description: PGP signature ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Mar 2, 2010, at 2:48 PM, David Magda wrote: > > On Mar 1, 2010, at 12:44, Richard Elling wrote: > >> On Mar 1, 2010, at 7:42 AM, Thomas Burgess wrote: >> >>> Also consider that you might not want to snapshot the entire pool. >> >> Snapshots work on the dataset, not the pool (there is no "zpool snapshot" >> command :-) > > Wouldn't a "zfs snapshot -r mypool" work? That is just a shorthand for snapshotting (snapshooting? :-) datasets. There still is no pool snapshot feature. Or to put it another way, there is no way inside ZFS to replicate a pool. This usually isn't a big deal because your data is in the datasets. -- richard ZFS storage and performance consulting at http://www.RichardElling.com ZFS training on deduplication, NexentaStor, and NAS performance http://nexenta-atlanta.eventbrite.com (March 16-18, 2010) ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Mar 1, 2010, at 12:44, Richard Elling wrote: On Mar 1, 2010, at 7:42 AM, Thomas Burgess wrote: Also consider that you might not want to snapshot the entire pool. Snapshots work on the dataset, not the pool (there is no "zpool snapshot" command :-) Wouldn't a "zfs snapshot -r mypool" work? -r Recursively create snapshots of all descendent datasets. Snapshots are taken atomically, so that all recursive snapshots correspond to the same moment in time. http://docs.sun.com/app/docs/doc/819-2240/zfs-1m ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Mon, March 1, 2010 22:58, Thomas Burgess wrote: > On Mon, Mar 1, 2010 at 12:44 PM, Richard Elling > wrote: > >> On Mar 1, 2010, at 7:42 AM, Thomas Burgess wrote: >> >> > Also consider that you might not want to snapshot the entire pool. >> >> Snapshots work on the dataset, not the pool (there is no "zpool >> snapshot" >> command :-) >> >> This is my entire point. Somehow it must have been missed due to me not > using my words properly. > > The OP asked what is the advantage of using separate filesystems instead > of > just one big filesystem > > My point is you may want to snapshot SOME stuff but not other stuff. Yes, that's the point. I understood you the first time, but whatever; if significant numbers of people don't, then finding a clearer way to say it is worth working on. > Even if there WAS a snapshot pool function. And there is, in most of our heads, such a function; since there's a filesystem at the pool level, and a "-r" switch :-). I think of "zfs snapshot -r rememberthispointint...@rpoool" as "taking a snapshot of rpool". I see that, if you're using volumes and such, that thinking starts to diverge more noticeably from reality. But I'm not, in my data pool, which is the one I care about. -- David Dyer-Bennet, d...@dd-b.net; http://dd-b.net/ Snapshots: http://dd-b.net/dd-b/SnapshotAlbum/data/ Photos: http://dd-b.net/photography/gallery/ Dragaera: http://dragaera.info ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
Ahh, interesting...once I get the data realatively stable in some of those sub-folders I wil create a file system, move the data in there and setup the snapshot for those that are relatively static...now I just need to do a load of reading about snapshots! Thanks again...sp much to learn. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
Eric D. Mudama wrote: On Sun, Feb 28 at 20:10, Erik Trimble wrote: Obviously, having different filesystems gives you the ability to set different values for attributes, which may substantially improve performance or storage space depending on the data in that filesystem. As an example above, I would consider turning compression on for your cloud/winbackups and possibly for cloud/data, but definitely not for either cloud/movies (assuming mpeg4 or similar files) or cloud/music. On Win7, the automatic backup service saves chunked ~200MB .zip files. These are unlikely to compress very well. --eric Let me just say:Yuk. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Mon, Mar 1, 2010 at 12:44 PM, Richard Elling wrote: > On Mar 1, 2010, at 7:42 AM, Thomas Burgess wrote: > > > Also consider that you might not want to snapshot the entire pool. > > Snapshots work on the dataset, not the pool (there is no "zpool snapshot" > command :-) > > This is my entire point. Somehow it must have been missed due to me not using my words properly. The OP asked what is the advantage of using separate filesystems instead of just one big filesystem My point is you may want to snapshot SOME stuff but not other stuff. Even if there WAS a snapshot pool function. > What usually trips me up is the auto-snapshot service and inherited > properties. > You will want to make sure and not snapshot those file systems which are > "temporary" in nature. You can do this with the advanced options section > of the Time Slider Manager GUI, or by setting the com.sun:auto-snapshot > parameter appropriately on your datasets. > -- richard > > yes, this is very annoying when this happens =) > ZFS storage and performance consulting at http://www.RichardElling.com > ZFS training on deduplication, NexentaStor, and NAS performance > http://nexenta-atlanta.eventbrite.com (March 16-18, 2010) > > > > > ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Sun, Feb 28 at 20:10, Erik Trimble wrote: Obviously, having different filesystems gives you the ability to set different values for attributes, which may substantially improve performance or storage space depending on the data in that filesystem. As an example above, I would consider turning compression on for your cloud/winbackups and possibly for cloud/data, but definitely not for either cloud/movies (assuming mpeg4 or similar files) or cloud/music. On Win7, the automatic backup service saves chunked ~200MB .zip files. These are unlikely to compress very well. --eric -- Eric D. Mudama edmud...@mail.bounceswoosh.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Mar 1, 2010, at 7:42 AM, Thomas Burgess wrote: > Also consider that you might not want to snapshot the entire pool. Snapshots work on the dataset, not the pool (there is no "zpool snapshot" command :-) What usually trips me up is the auto-snapshot service and inherited properties. You will want to make sure and not snapshot those file systems which are "temporary" in nature. You can do this with the advanced options section of the Time Slider Manager GUI, or by setting the com.sun:auto-snapshot parameter appropriately on your datasets. -- richard ZFS storage and performance consulting at http://www.RichardElling.com ZFS training on deduplication, NexentaStor, and NAS performance http://nexenta-atlanta.eventbrite.com (March 16-18, 2010) ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
Also consider that you might not want to snapshot the entire pool. For instance, if you have a media server, you may have a dump dir and a torrent dir, you probably wouldn 't want to snapshot this because it changes a lot and the snapshots could grow very large (or you may wish to snapshot it but only for a couple days back) Where you may wish to keep snapshots going back way further on your other filesystems. You may also want to use dedup on some filesystems and not others. I also keep separate filesystems for different uses on my network and then use different ACL's and cifs mounts, where i have a couple filesystems which are read write to everyone, and others which are read only and then each user has thier own share which is only for themFor this type of stuff, it's cool. On Sun, Feb 28, 2010 at 10:24 PM, tomwaters wrote: > Hi guys, on my home server I have a variety of directories under a single > pool/filesystem, Cloud. > > Things like > cloud/movies -> 4TB > cloud/music -> 100Gig > cloud/winbackups -> 1TB > cloud/data -> 1TB > > etc. > > After doing some reading, I see recomendations to have separate filesystem > to improve performance...but not sure how as it's the same pool? > > Can someone help me understand if/why I should use separate file systems > for these? > > ta. > -- > This message posted from opensolaris.org > ___ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss > ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
On Sun, February 28, 2010 21:24, tomwaters wrote: > Hi guys, on my home server I have a variety of directories under a single > pool/filesystem, Cloud. > > Things like > cloud/movies -> 4TB > cloud/music -> 100Gig > cloud/winbackups -> 1TB > cloud/data -> 1TB > > etc. > > After doing some reading, I see recomendations to have separate filesystem > to improve performance...but not sure how as it's the same pool? It's the same pool, so it's the same IO bandwidth limits, you're right about that. > Can someone help me understand if/why I should use separate file systems > for these? It helps with management. Quotas are by filesystem, for example. Also you can select compression and deduplication and eventually encryption per filesystem. Also you can snapshot them independently if you want. And my environment has few enough filesystems that I'm not feeling the pain from doing it; so I may not have thought it through completely. -- David Dyer-Bennet, d...@dd-b.net; http://dd-b.net/ Snapshots: http://dd-b.net/dd-b/SnapshotAlbum/data/ Photos: http://dd-b.net/photography/gallery/ Dragaera: http://dragaera.info ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
Thanks for that Erik. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What's the advantage of using multiple filesystems in a pool
tomwaters wrote: Hi guys, on my home server I have a variety of directories under a single pool/filesystem, Cloud. Things like cloud/movies -> 4TB cloud/music -> 100Gig cloud/winbackups -> 1TB cloud/data -> 1TB etc. After doing some reading, I see recomendations to have separate filesystem to improve performance...but not sure how as it's the same pool? Can someone help me understand if/why I should use separate file systems for these? ta. Obviously, having different filesystems gives you the ability to set different values for attributes, which may substantially improve performance or storage space depending on the data in that filesystem. As an example above, I would consider turning compression on for your cloud/winbackups and possibly for cloud/data, but definitely not for either cloud/movies (assuming mpeg4 or similar files) or cloud/music. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] What's the advantage of using multiple filesystems in a pool
Hi guys, on my home server I have a variety of directories under a single pool/filesystem, Cloud. Things like cloud/movies -> 4TB cloud/music -> 100Gig cloud/winbackups -> 1TB cloud/data -> 1TB etc. After doing some reading, I see recomendations to have separate filesystem to improve performance...but not sure how as it's the same pool? Can someone help me understand if/why I should use separate file systems for these? ta. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
