So you are running 16 map tasks per node? Plus 2 reducers? I think that's high. With 6gb RAM, you should be looking at around 2 map tasks plus 1 reducer... I have 9 nodes with quad core + 8gb RAM and I run 2M+1R on each node..
How much heap size have you given your hadoop instance? Also, is there a lot of processing going on in the mappers and reducers? On 8/12/09, Mayuran Yogarajah <[email protected]> wrote: > Amandeep Khurana wrote: >> >> Ah.. That might be the issue.. I dont know the solution to this.. Wait for >> someone else to answer. The mappers not starting could be because of this >> as >> well. >> >> Whats your cluster configuration? How many cpu's, RAM etc...? >> >> > There are 6 servers in the cluster, they're all the same hardware > cpu/ram wise: 2xquad core > and 6gigs of ram. > > thanks, > M > > > -- Amandeep Khurana Computer Science Graduate Student University of California, Santa Cruz
