(I committed my proper fix BTW.) The job itself doesn't override these values. If they're not what you set, then Hadoop is changing them. I am not entirely familiar with its rules, but think it limits or alters the number of workers to fit the distribution of the input, available cores, etc.
On Thu, May 6, 2010 at 12:22 PM, Tamas Jambor <jambo...@googlemail.com> wrote: > I set the default values in mapred-site.xml, but when I run the job and > check the settings there are different values. I could force to use the > default values, but that's not optimal either in some cases. > > On 06/05/2010 11:36, Sean Owen wrote: >> >> Where do you see it setting mappers and reducers? it shouldn't, and >> doesn't as far as I can see. Hadoop may be overriding your settings. >> >
