All reducer tasks are finished, while some mapper tasks are still running
-------------------------------------------------------------------------
Key: HADOOP-5660
URL: https://issues.apache.org/jira/browse/HADOOP-5660
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.18.3
Reporter: Qi Liu
In a high load environment (i.e. multiple jobs are queued up to be executed),
when all reducer tasks of a job are finished, some mapper tasks of the same job
may still running (possibly re-executed due to lost task tracker, etc).
This should not happen when a job has at least one reducer task. When all
reducer tasks are in SUCCEEDED state, the Hadoop JobTracker should kill all
running mapper tasks, since execution would be meaningless. The job should also
switch to SUCCEEDED state when all reducer tasks of that job succeeded
successfully.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
