This (slaves) is a configuration parameter (look at bin/hadoop-config.sh) which is set once you start mapreduce cluster (execute "start-mapred.sh"). You can change the slaves by executing "stop-mapred.sh", changing the slaves file and running "start-mapred.sh" between the jobs. You can also stop/start new slaves (task trackers) between the jobs using parameters "mapred.hosts.exclude" and "mapred.hosts" (I think hadoop tutorial provides help on that) but all these methods require you to restart mapreduce cluster.
On Tue, Sep 27, 2011 at 11:50 AM, bikash sharma <sharmabiks...@gmail.com> wrote: > Hi -- Can we specify a different set of slaves for each mapreduce job run. > I tried using the --config option and specify different set of slaves in > slaves config file. However, it does not use the selective slaves set but > the one initially configured. > > Any help? > > Thanks, > Biksah >
