All configs are per node. No HBase, only Hive and Pig installed On Tue, Oct 2, 2012 at 9:40 PM, Michael Segel <michael_se...@hotmail.com>wrote:
> I think he's saying that its 24 maps 8 reducers per node and at 48GB that > could be too many mappers. > Especially if they want to run HBase. > > On Oct 2, 2012, at 8:14 PM, hadoopman <hadoop...@gmail.com> wrote: > > > Only 24 map and 8 reduce tasks for 38 data nodes? are you sure that's > right? Sounds VERY low for a cluster that size. > > > > We have only 10 c2100's and are running I believe 140 map and 70 reduce > slots so far with pretty decent performance. > > > > > > > > On 10/02/2012 12:55 PM, Alexander Pivovarov wrote: > >> 38 data nodes + 2 Name Nodes > >> > > > >> > > Data Node: > >> > > Dell PowerEdge C2100 series > >> > > 2 x XEON x5670 > >> > > 48 GB RAM ECC (12x4GB 1333MHz) > >> > > 12 x 2 TB 7200 RPM SATA HDD (with hot swap) JBOD > >> > > Intel Gigabit ET Dual port PCIe x4 > >> > > Redundant Power Supply > >> > > Hadoop CDH3 > >> > > max map tasks 24 > >> > > max reduce tasks 8 > > > > > >
