On Thu, Mar 6, 2014 at 6:33 AM, Alex Adriaanse <[email protected]> wrote:
> We're needing to store many TBs of data (somewhere between 10TB and 50TB) > on a SmartOS server (or cluster of SmartOS servers). Most of this data will > be fairly static, and the files that will take up this space will typically > average around 1MB in size. Performance isn't going to be a huge concern, > except that we'll also house a database server where performance is a bit > more important (although two 7200RPM drives in a mirrored zpool seem to be > holding up currently just fine). We'll be using zones for most virtual > machines on this server. > > We're looking at getting a dedicated server with a 36 hard drive bay > chassis to give us lots of room for growth. I'm envisioning we have two > options: > > 1. Create one giant zpool that will eventually span up to ~32 hard > drives and dump all the files in there. When using 4TB drives in RAID10, > this would give us 32TB of usable storage. > > This really isn't that difficult to do with SmartOS. I'm doing something similar right now with my SmartOS setup. I created a volume called /zpool/data, then I have volumes under that for each primary mount point (e.g., /zpool/data/projects). I turned nfs sharing on for each volume than then mount them with nfs in my vms. Many will tell you to use delegated datasets instead for the data volumes, but I didn't like that these volumes were attached to the vm. I wanted basically a NAS inside SmartOS given that is uses ZFS. For me it has worked great because my data is independent of my vms and I can do snapshots and what not of my data independent of the VMs. Greg > > 1. This would be the easiest solution because we could dump most of > our data in a single filesystem. However, I'm concerned about scalability > and reliability, as the wrong two hard drives going out at the same time > would kill the entire zpool, and also dealing with a ~32TB filesystem may > be challenging (we use zfs send/receive to replicate our data to an offsite > mirror server, so at some point the diffs between snapshots will become > huge as we collect more and more data; the initial full zfs send/receive > would take forever, too). > 2. We create one zpool for each group of 4 hard drives in RAID10 (with > 4TB hard drives this would give us 8TB of usable space per zpool). This > would require some forethought in our application as we'd have to split our > data carefully to make sure it doesn't exceed 8TB per filesystem, but this > shouldn't be a big deal. > > > I'm leaning towards the second option. How would you recommend we setup > the zpool(s) on this server? Are there other options I haven't thought of > that I should explore? > > Thanks, > > Alex > *smartos-discuss* | > Archives<https://www.listbox.com/member/archive/184463/=now> > <https://www.listbox.com/member/archive/rss/184463/25141435-45243113> | > Modify<https://www.listbox.com/member/?&;>Your Subscription > <http://www.listbox.com> > ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
