my configs are given below:
in hadoop-site number of mapper = 130
in my code I use job.setNumMapTasks = 130
in hadoop-default numberof mapper = 2
in this configuration I have taken 135 mapper in my job. However there
is no problem in number of reducer.
Andrzej Bialecki wrote:
Murat Ali Bayir wrote:
Hi everbody, Although I change the number of mappers in
hadoop-site.xml and use job.setNumMapTasks method the system gives
another number as a number of mapper, the problem only occurs for
number of mapper, number of reducers works correctly. What I have to
do for setting the number of mappers in the system?
Any value that you put in hadoop-site.xml will always override any
other config settings, even those set programatically in
job.setNumMapTasks. You should remove these settings from hadoop-site,
and put them into mapred-default.xml.
