it can not be problem, it only restrict the number of tasks running simultaneously, there can be pending tasks also, i check that this not problem. I am not sure but I notice that the number of mapper tasks is equal to k*number of different parts in input path. To illusrate I have 15 parts in my input path, I set the number of mappers 130 in hadoop-site.xml however when I run the job I have 135 mapper which is 9 times of number of input part.
Dennis Kubes wrote: > There is also a mapred.tasktracker.tasks.maximum variable which may be > causing the task number to be different. > > Dennis > > Murat Ali Bayir wrote: > >> Hi everbody, Although I change the number of mappers in >> hadoop-site.xml and use job.setNumMapTasks method the system gives >> another number as a number of mapper, the problem only occurs for >> number of mapper, number of reducers works correctly. What I have to >> do for setting the number of mappers in the system? > > > > . > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
