On Mon, 3 Aug 2009, Joachim Sandvik wrote:
We are looking at a dual cpu Supermicro server with about 32gb ram
and 2 x250gb OS disks, 21 x 1TB SATA disks, and 1 x 64gb SSD disk.
The system will use nexenta's auto-cdp which i think are based on
AVS to remote mirror to a system a few miles away. The system will
mostly be serving as a NFS server for our Vmware servers. We have
about 80 vm's who access the vmfs datastores.
I have read that its smart to use a few small raid groups in a
larger pools, but i am uncertain about placing 21 disks in 1pool.
21 disks in 1 pool should not be a problem.
The setup i have though of so far are:
1 pool with 3 x raidz2 groups with 6x1tb disks. 2x 64gb ssd for
cache and 2 spare disks. This should give us about 12TB
An another setup i have been thinking about is:
1 pool with 9 x mirror with 2 x 1TB, also with 2 spares and 2 64gb SSD.
Do anyone have a recommendation on what might be a good setup?
The mirror configuration will provide much better multiuser
performance (IOPS) since it offers so many more vdevs (9 vs 3) and the
vdevs are simple. The MTTDL is not quite as good as raidz2 but since
you are providing spare disks, and because resilver of a mirror disk
is fast, it should be quite reliable. If you do a periodic scrub of
the array, there should not be much concern about read errors during
resilver.
The mirror configuration will provide much better random read
performance than raidz2 since any drive in the mirror may be used to
return a read request (similar to 18 readable vdevs vs 3).
Usually when raidz2 is used, many more disks are used per vdev so that
it is more space efficient but in your case it is not that much more
space efficent than mirroring (12GB vs 9GB).
If 9GB is enough space for your needs, then it is likely that mirrors
are the best configuration. It is safer to err in the direction of
more performance since you can always add disk later if you need more
space, but adding performance is more expensive once the data is in
place.
Bob
--
Bob Friesenhahn
bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer, http://www.GraphicsMagick.org/
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss