my configs are given below: in hadoop-site number of mapper = 130 in my code I use job.setNumMapTasks = 130 in hadoop-default numberof mapper = 2 in this configuration I have taken 135 mapper in my job. However there is no problem in number of reducer.
Andrzej Bialecki wrote: > Murat Ali Bayir wrote: > >> Hi everbody, Although I change the number of mappers in >> hadoop-site.xml and use job.setNumMapTasks method the system gives >> another number as a number of mapper, the problem only occurs for >> number of mapper, number of reducers works correctly. What I have to >> do for setting the number of mappers in the system? > > > Any value that you put in hadoop-site.xml will always override any > other config settings, even those set programatically in > job.setNumMapTasks. You should remove these settings from hadoop-site, > and put them into mapred-default.xml. > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
