Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
i could probably do 16 disks and maybe do a raidz on both for 14 disks usable combined... that's probably as redundant as i'd need, i think. can you combine two zpools together? or will i have two separate partitions (i.e. i'll have tank for example and tank2 instead of making one single large

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Miles Nordin
m == mike [EMAIL PROTECTED] writes: m can you combine two zpools together? no. You can have many vdevs in one pool. for example you can have a mirror vdev and a raidz2 vdev in the same pool. You can also destroy pool B, and add its (now empty) devices to pool A. but once two separate

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
see, originally when i read about zfs it said it could expand to petabytes or something. but really, that's not as a single filesystem ? that could only be accomplished through combinations of pools? i don't really want to have to even think about managing two separate partitions - i'd like to

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Claus Guttesen
see, originally when i read about zfs it said it could expand to petabytes or something. but really, that's not as a single filesystem ? that could only be accomplished through combinations of pools? i don't really want to have to even think about managing two separate partitions - i'd

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Peter Tribble
On Fri, Aug 22, 2008 at 8:11 AM, mike [EMAIL PROTECTED] wrote: see, originally when i read about zfs it said it could expand to petabytes or something. but really, that's not as a single filesystem ? that could only be accomplished through combinations of pools? i don't really want to have

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Robert Milkowski
Hello mike, Friday, August 22, 2008, 8:11:36 AM, you wrote: m see, originally when i read about zfs it said it could expand to m petabytes or something. but really, that's not as a single m filesystem ? that could only be accomplished through combinations of pools? m i don't really want to have

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
likewise i could also do something like zpool create tank raidz1 disk1 disk2 disk3 disk4 disk5 disk6 disk7 \ raidz1 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 and i'd have a 7 disk raidz1 and an 8 disk raidz1... and i'd have 15 disks still broken up into not-too-horrible pool sizes

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: likewise i could also do something like zpool create tank raidz1 disk1 disk2 disk3 disk4 disk5 disk6 disk7 \ raidz1 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 and i'd have a 7 disk raidz1 and an 8 disk raidz1... and i'd have 15 disks still broken up into

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross
Hey Mike, First of all, I'd strongly suggest going for raidz2 instead of raidz. Dual parity protection is something I'd strongly recommended over single parity protection. You also don't mention your boot pool. You can't boot from a raid pool, so you need to put one disk aside for booting

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Tim
14+2 or 7+1 On 8/22/08, Miles Nordin [EMAIL PROTECTED] wrote: m == mike [EMAIL PROTECTED] writes: m can you combine two zpools together? no. You can have many vdevs in one pool. for example you can have a mirror vdev and a raidz2 vdev in the same pool. You can also destroy pool

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
I hear everyone's concerns about multiple parity disks. Are there any benchmarks or numbers showing the performance difference using a 15 disk raidz2 zpool? I am fine sacrificing some performance but obviously don't want to make the machine crawl. It sounds like I could go with 15 disks evenly

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Claus Guttesen
Are there any benchmarks or numbers showing the performance difference using a 15 disk raidz2 zpool? I am fine sacrificing some performance but obviously don't want to make the machine crawl. It sounds like I could go with 15 disks evenly and have to sacrifice 3, but I would have 1 parity

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
Oh sorry - for boot I don't care if it's redundant or anything. Worst case the drive fails, I replace it and reinstall, and just re-mount the ZFS stuff. If I have the space in the case and the ports I could get a pair of 80 gig drives or something and mirror them using SVM (which was

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: And terminology-wise, one or more zpools create zdevs right? No that isn't correct. One or move vdevs create a pool. Each vdev in a pool can be a different type, eg a mix or mirror, raidz, raidz2. There is no such thing as zdev. -- Darren J Moffat

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
No that isn't correct. One or move vdevs create a pool. Each vdev in a pool can be a different type, eg a mix or mirror, raidz, raidz2. There is no such thing as zdev. Sorry :) Okay, so you can create a zpool from multiple vdevs. But you cannot add more vdevs to a zpool once the zpool is

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Darren J Moffat
mike wrote: No that isn't correct. One or move vdevs create a pool. Each vdev in a pool can be a different type, eg a mix or mirror, raidz, raidz2. There is no such thing as zdev. Sorry :) Okay, so you can create a zpool from multiple vdevs. But you cannot add more vdevs to a zpool

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: Sorry :) Okay, so you can create a zpool from multiple vdevs. But you cannot add more vdevs to a zpool once the zpool is created. Is that right? Nope. That's exactly what you *CAN* do. So say today you only really need 6TB usable, you could go buy 8 of your 1TB disks, and setup

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Darren J Moffat [EMAIL PROTECTED] wrote: I could if I wanted to add another vdev to this pool but it doesn't have to be raidz it could be raidz2 or mirror. If they did they are wrong, hope the above clarifies. I get it now. If you add more disks they have to be in their own

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Bill Sommerfeld
On Thu, 2008-08-21 at 21:15 -0700, mike wrote: I've seen 5-6 disk zpools are the most recommended setup. This is incorrect. Much larger zpools built out of striped redundant vdevs (mirror, raidz1, raidz2) are recommended and also work well. raidz1 or raidz2 vdevs of more than a single-digit

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Rich Teer
On Fri, 22 Aug 2008, mike wrote: Oh sorry - for boot I don't care if it's redundant or anything. 8-O Worst case the drive fails, I replace it and reinstall, and just re-mount the ZFS stuff. If you use a ZFS mirrored root, you just replace a drive when it fails. None of this reinstall

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Kyle McDonald [EMAIL PROTECTED] wrote: Antoher note, as someone said earlier, if you can go to 16 drives, you should consider 2 8disk RAIDZ2 vDevs, over 2 7disk RAIDZ vDevs with a spare, or (I would think) even a 14disk RAIDZ2 vDev with a spare. If you can (now or later) get room

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
It looks like this will be the way I do it: initially: zpool create mypool raidz2 disk0 disk1 disk2 disk3 disk4 disk5 disk6 disk7 when I need more space and buy 8 more disks: zpool add mypool raidz2 disk8 disk9 disk10 disk11 disk12 disk13 disk14 disk15 Correct? Enable compression, and set up

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Rich Teer [EMAIL PROTECTED] wrote: ZFS boot works fine; it only recently integrated into Nevada, but it has been in use for quite some time now. Yeah I got the install option when I installed snv_94 but wound up not having enough disks to use it. Even better: just use ZFS root

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Chris Cosby
On Fri, Aug 22, 2008 at 1:08 PM, mike [EMAIL PROTECTED] wrote: It looks like this will be the way I do it: initially: zpool create mypool raidz2 disk0 disk1 disk2 disk3 disk4 disk5 disk6 disk7 when I need more space and buy 8 more disks: zpool add mypool raidz2 disk8 disk9 disk10 disk11

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: Or do smaller groupings of raidz1's (like 3 disks) so I can remove them and put 1.5TB disks in when they come out for instance? I wouldn't reduce it to 3 disks (should almost mirror if you go that low.) Remember, while you can't take a drive out of a vDev, or a vDev out of a

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Jacob Ritorto
While on the subject, in a home scenario where one actually notices the electric bill personally, is it more economical to purchase a big expensive 1tb disk and save on electric to run it for five years or to purchase two cheap 1/2 TB disk and spend double on electric for them for 5 years? Has

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Kyle McDonald
mike wrote: On 8/22/08, Rich Teer [EMAIL PROTECTED] wrote: ZFS boot works fine; it only recently integrated into Nevada, but it has been in use for quite some time now. Yeah I got the install option when I installed snv_94 but wound up not having enough disks to use it. You

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Kyle McDonald [EMAIL PROTECTED] wrote: You only need 1 disk to use ZFS root. You won't have any redundancy, but as Darren said in another email, you can convert single device vDevs to Mirror'd vDevs later without any hassle. I'd just get some 80 gig disks and mirror them. Might as

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Bob Friesenhahn
On Fri, 22 Aug 2008, Jacob Ritorto wrote: While on the subject, in a home scenario where one actually notices the electric bill personally, is it more economical to purchase a big expensive 1tb disk and save on electric to run it for five years or to purchase two cheap 1/2 TB disk and spend

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Miles Nordin
m == mike [EMAIL PROTECTED] writes: m that could only be accomplished through combinations of pools? m i don't really want to have to even think about managing two m separate partitions - i'd like to group everything together m into one large 13tb instance You're not

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross
Yes, that looks pretty good mike. There are a few limitations to that as you add the 2nd raidz2 set, but nothing major. When you add the extra disks, your original data will still be stored on the first set of disks, if you've any free space left on those you'll then get some data stored

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
On 8/22/08, Ross [EMAIL PROTECTED] wrote: Yes, that looks pretty good mike. There are a few limitations to that as you add the 2nd raidz2 set, but nothing major. When you add the extra disks, your original data will still be stored on the first set of disks, if you've any free space left

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread Ross Smith
] Subject: Re: [zfs-discuss] Best layout for 15 disks? CC: zfs-discuss@opensolaris.org On 8/22/08, Ross [EMAIL PROTECTED] wrote: Yes, that looks pretty good mike. There are a few limitations to that as you add the 2nd raidz2 set, but nothing major. When you add the extra disks, your

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-22 Thread mike
yeah i am on gigabit, but the clients are things like an xbox which is only 10/100, etc. right now the setup works fine. i'm thinking the new CIFS implementation should make it run even cleaner too. On 8/22/08, Ross Smith [EMAIL PROTECTED] wrote: Yup, you got it, and an 8 disk raid-z2 array

[zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread mike
Question #1: I've seen 5-6 disk zpools are the most recommended setup. In traditional RAID terms, I would like to do RAID5 + hot spare (13 disks usable) out of the 15 disks (like raidz2 I suppose). What would make the most sense to setup 15 disks with ~ 13 disks of usable space? This is for a

Re: [zfs-discuss] Best layout for 15 disks?

2008-08-21 Thread Will Murnane
On Fri, Aug 22, 2008 at 00:15, mike [EMAIL PROTECTED] wrote: Question #1: I've seen 5-6 disk zpools are the most recommended setup. In traditional RAID terms, I would like to do RAID5 + hot spare (13 disks usable) out of the 15 disks (like raidz2 I suppose). What would make the most sense