following are some thoughts if it's not too late:
1 SuperMicro 847E1-R1400LPB
I guess you meant the 847E1[b]6[/b]-R1400LPB, the SAS1 version makes no sense
1 SuperMicro H8DG6-F
not the best choice, see below why
171 Hitachi 7K3000 3TB
I'd go for the more environmentally friendly Ultrastar 5K3000 version - with
that many drives you wont mind the slower rotation but WILL notice a difference
in power and cooling cost
1 LSI SAS 9202-16e
this is really only a very expensive gadget to be honest, there's really no
point to it - especially true when you start looking for the necessary cables
that use a connector who's still in draft specification...
stick to the excellent LSI SAS9200-8e, of which you will need at least 3 in
your setup, one to connect each of the 3 JBODS - with them filled with fast
drives like you chose, you will need two links (one for the front and one for
the back backplane) as daisychainig the backplanes together would oversaturate
a single link.
if you'd want to take advantage of the dual expanders on your JBOD backplanes
for additional redundancy in case of expander or controller failure, you will
need 6 of those LSI SAS9200-8e - this is where your board isn't ideal as it
has a 3/1/2 PCIe x16/x8/x4 configuration while you'd need 6 PCIe x8 - something
the X8DTH-6F will provide, as well as the onboard LSI SAS2008 based HBA for the
two backplanes in the server case.
1 LSI SAS 9211-4i
2 OCZ 64GB SSD Vertex 3
2 OCZ 256GB SSD Vertex 3
if these are meant to be connected together and used as ZIL+L2ARC, then I'd
STRONGLY urge you to get the following instead:
1x LSI MegaRAID SAS 9265-8i
1x LSI FastPath licence
4-8x 120GB or 240GB Vertex 3 Max IOPS Edition, whatever suits the budget
this solution allows you to push around 400k IOPS to the cache, more than
likely way more than the stated appication of the system will need
1 NeterionX3120SR0001
I don't know this card personally but since it's not listed as supported
(http://www.sun.com/io_technologies/nic/NIC1.html) I'd be careful
My question is what is the optimum way of dividing
these drives across vdevs?
I would do 14 x 12 drive raidz2 + 3 spare = 140*3TB = ~382TiB usable
this would allow for a logical mapping of drives to vdevs, giving you in each
case 2 vdevs in the front and 1 in the back with the 9 drive blocks in the back
of the JBODs used as 3 x 4/4/1, giving the remaining 2 x 12 drive vdevs plus
one spare per case
I could also go with 2TB drives and add an extra 45
JBOD chassis. This would significantly decrease cost,
but I'm running a gauntlet by getting very close to
minimum useable space.
12 x 18 drive raidz2
I would never do vdevs that large, it's just an accident waiting to happen!
hopefully these recommendations help you with your project. in any case, it's
huge - the biggest system I worked on (which I actually have at home, go
figure) only has a bit over 100TB in the following configuration:
6 x 12 drive raidz2 of Hitachi 5K3000 2TB
3 Norco 4224 with a HP SAS Expander in each
Supermicro X8DTi-LN4F with 3x LSI SAS9200-8e
so yeah, I based my thoughts on my own system but considering that it's been
running smoothly for a while now (and that I had a very similar setup with
smaller drives and older controllers before), I'm confident in my suggestions
Regards from Switzerland,
voyman
--
This message posted from opensolaris.org
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
