Drew, Adding to this discussion Š I believe you¹ll have to go with an add-on option of some sort. Your best bet if you want to use Crowbar (good idea!) is to use a supported card, as Mike discusses below. If you choose not to go with a supported add-on board, you might look at the Ceph performance testing data posted at:
http://ceph.com/community/ceph-performance-part-1-disk-controller-write-thr oughput/ and http://ceph.com/community/ceph-performance-part-2-write-throughput-without- ssd-journals/ Ceph does not have the same exact demands as Hadoop; but I¹m sure the demand is very similar, the results highlight a few of the cost options, in relation to the performance benchmarks obtained from those other controllers. Included in the test is the LSI 9207 that Mike mentions (which uses the LSI SAS2308 chipset) - this card is available around $240 - and probably cheaper if you look around hard enough. If you run the PERC H710 (or H710P), you need to ³bubble up² the disks as JBOD via ³fake JBOD² mode. The PERC doesn¹t natively support ³pass-through² or ³JBOD² modes. To do that, you simply configure a RAID 0 set with a single HDD in it. There are discussions about ³fake JBOD² mode on HBAs and performance implications in the testing data above. However - note the tests above DO NOT include Dell PERC controllers, so you can¹t (necessarily) extrapolate the test results to how the PERC H710 would perform. I believe that the Crowbar team has been working on some performance benchmarks with the Dell hardware and Crowbar/Cloudera built solution. I¹m looking forward to that testing data, and hoping they might have some comparisons of different HBA/Controllers in relation to the performance obtained in different configurations (similar to the Ceph ³bake off² in the above links). Note that not using a tested/certified controller with Crowbar Š we¹ll YMMV Š ~~shane On 10/23/13, 12:18 PM, "Pittaro, Michael" <[email protected]> wrote: >Drew, > >We have Cloudera Hadoop Reference Architectures based on the R720 / >R7200xd and the C8000 series which are fully supported by Crowbar, and >there are also customers running on many other configurations without >Crowbar. > >We never see the onboard SATA controllers used for Hadoop data nodes. >They're good enough for boot drives, but really aren't intended for the >sort of loads HDFS puts on them. The most common controllers with R >Series are the H710 and the LSI 9207, either of which gives you 6 Gb/s >SATA or SAS. With the R720xd, we use either 12 x 3.5" drives or 24 x >2.5" drives. > >The LSI 9207 was recently certified on the R720, and is very popular >right now. Prior to that, the H710 was the preferred option. Crowbar >supports both. The LSI9207 support hasn't made in into the hadoop >branches yet, but is in progress. > >mike > >On 10/23/2013 1:32 PM, Jakesch, Simon wrote: >> Drew, >> >> while this list generally isn¹t a sales channel, I¹ve asked around and >> it appears there¹s really no configuration that supports more than 6 >> drives on the internal SATA controller. There is a small chance that the >> C8220x supports 8 (you should ask a rep). >> >> The best alternative we generally see customers pick is the LSI 9207 on >> the R720XD. It¹s basically a JBOD style controller which is fairly >> inexpensive >> >>(http://www.lsi.com/downloads/Public/Host%20Bus%20Adapters/LSI_SAS9207-8i >>_UG.pdf). >> We¹ve recently added support for it to Crowbar as well. >> >> Hope this helps, >> >> Simon >> >> *From:*crowbar-bounces *On Behalf Of *Drew Weaver >> *Sent:* Wednesday, October 23, 2013 9:00 AM >> *To:* crowbar >> *Subject:* [Crowbar] Cloudera hadoop deployment hardware inquiry >> >> Howdy, >> >> This isn¹t really just specific to crowbar but we want to use crowbar to >> deploy a Cloudera Hadoop cluster. >> >> The problem which we are running into is that the Dell hardware that we >> are targeting (the R720) does not have the ability to direct attach hard >> drives to the on-board SATA and as a result we are having to pay >> $400-$500 per node extra for a RAID controller which we don¹t want. >> >> Does anyone who has used crowbar in the past to build Cloudera Hadoop >> clusters know of a Dell server that is supported by Crowbar that has the >> ability to have 8x hard drives directly attached to the onboard SATA? >> >> I¹m currently buying servers from the PowerEdge space but I suppose >> there may be something in the Cxxxx series? >> >> Thanks and sorry for list noise. >> >> -Drew >> > >_______________________________________________ >Crowbar mailing list >[email protected] >https://lists.us.dell.com/mailman/listinfo/crowbar >For more information: http://crowbar.github.com/ _______________________________________________ Crowbar mailing list [email protected] https://lists.us.dell.com/mailman/listinfo/crowbar For more information: http://crowbar.github.com/
