teng wang created MAPREDUCE-7423:
------------------------------------
Summary: The check for maxtaskfailures.per.tracker is missing
Key: MAPREDUCE-7423
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7423
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tasktracker
Affects Versions: 3.3.4
Reporter: teng wang
In the conf file mapred-default.xml, the description of
*mapreduce.job.maxtaskfailures.per.tracker* is:
The number of task-failures on a node manager of a given job after which new
tasks of that job aren't assigned to it. It *MUST be less* than
mapreduce.map.maxattempts and mapreduce.reduce.maxattempts otherwise the failed
task will never be tried on a different node.
However, there is no checking implement in source code. Violations of the
dependency will prevent failed tasks from trying on different nodes. So, it is
suggested to check the dependency of the two configuration parameters before
using maxtaskfailures.per.tracker.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
