I've passed in the following line through the code for my m/r job:
conf.set("mapred.tasktracker.reduce.tasks.maximum", "4"), wanting that to
override the value of 8 set in my mapred-conf.site files on my ten-node
cluster.
Sure enough, when I look at the job configuration in the web UI for the
jobTracker, I see that value set to four, as desired.
But the number of reduce tasks currently running is 80, as before. Should
be a maximum of 40 now, with the new value of 4 for the property above.
So what I'm wondering is, is that value of 4 being ignored somehow? Seems
like a bug if so...
Thanks for any help...