That is a bit problematic because I have other jobs running at the same time, most of them don't care about the number of map tasks per tasktracker. Is there a way to implement this in in my job project? What is the best way to do it?
On Tue, Jun 21, 2011 at 8:08 PM, Joey Echeverria <j...@cloudera.com> wrote: > The only way to do that is to drop the setting down to one and bounce > the TaskTrackers. > > -Joey > > On Tue, Jun 21, 2011 at 12:52 PM, Jonathan Zukerman > <zukermanjonat...@gmail.com> wrote: > > Hi, > > Is there a way to set the maximum map tasks for all tasktrackers in my > > cluster for a certain job? > > Most of my tasktrackers are configured to handle 4 maps concurrently, and > > most of my jobs don't care where does the map function run. But small > part > > of my jobs requires that no two map functions will run from the same IP > at > > the same time, i.e., the maximum number of map tasks for each tasktracker > > should be 1 for these jobs. > > Thanks! > > Jonathan. > > > > -- > Joseph Echeverria > Cloudera, Inc. > 443.305.9434 >
