I am using a Hadoop manager, and it stores the values in a database, outside the configuration files.
On Tue, Nov 13, 2012 at 10:27 AM, Jay Vyas <[email protected]> wrote: > Hmmm What do you mean wrong configuration file.? How could that ever > happen? > > Jay Vyas > > On Nov 13, 2012, at 10:25 AM, Mark Kerzner <[email protected]> > wrote: > > Exactly! I found the right one, and it is 80. > > Thank you, > Mark > > On Tue, Nov 13, 2012 at 10:23 AM, Serge Blazhiyevskyy < > [email protected]> wrote: > >> Look on the job tracker web UI is parameter has taken effect (port 50030) >> >> It might be in the wrong config file or something >> >> >> Serge >> >> From: Mark Kerzner <[email protected]<mailto: >> [email protected]>> >> Reply-To: "[email protected]<mailto:[email protected]>" < >> [email protected]<mailto:[email protected]>> >> Date: Tuesday, November 13, 2012 5:19 PM >> To: "[email protected]<mailto:[email protected]>" < >> [email protected]<mailto:[email protected]>> >> Subject: Re: mapred.tasktracker.map.tasks.maximum >> >> 1.0.1 >> >> On Tue, Nov 13, 2012 at 10:18 AM, Serge Blazhiyevskyy < >> [email protected]<mailto:[email protected]>> wrote: >> What hadoop version are we talking about? >> >> From: Mark Kerzner <[email protected]<mailto: >> [email protected]><mailto:[email protected]<mailto: >> [email protected]>>> >> Reply-To: "[email protected]<mailto:[email protected]><mailto: >> [email protected]<mailto:[email protected]>>" < >> [email protected]<mailto:[email protected]><mailto: >> [email protected]<mailto:[email protected]>>> >> Date: Tuesday, November 13, 2012 5:16 PM >> To: Hadoop User <[email protected]<mailto:[email protected] >> ><mailto:[email protected]<mailto:[email protected]>>> >> Subject: mapred.tasktracker.map.tasks.maximum >> >> Hi, >> >> I have a cluster with 4 nodes and 32 many cores on each. My default value >> for the maximum number of mappers per slot is 1: >> >> <property> >> <name>mapred.tasktracker.map.tasks.maximum</name> >> <!-- see other kb entry about this one. --> >> <value>1</value> >> <final>true</final> >> </property> >> (which I think is wrong). >> >> Howeve, when sizable jobs run, I see 65 mappers working, so it seems that >> it does create more than 1 mapper per node. >> >> Questions: what maximum number of mappers would be appropriate in this >> situation? Is that the right way to set them? >> >> Thank you. Sincerely, >> Mark >> >> >
