Prior code fix in Capacity Scheduler prevents speculative execution in jobs
---------------------------------------------------------------------------
Key: HADOOP-4981
URL: https://issues.apache.org/jira/browse/HADOOP-4981
Project: Hadoop Core
Issue Type: Bug
Reporter: Vivek Ratan
Priority: Critical
As part of the code fix for HADOOP-4035, the Capacity Scheduler obtains a task
from JobInProgress (calling obtainNewMapTask() or obtainNewReduceTask()) only
if the number of pending tasks for a job is greater than zero (see the if-block
in TaskSchedulingMgr.getTaskFromJob()). So, if a job has no pending tasks and
only has running tasks, it will never be given a slot, and will never have a
chance to run a speculative task.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
