[
https://issues.apache.org/jira/browse/MAPREDUCE-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12728337#action_12728337
]
Arun C Murthy commented on MAPREDUCE-725:
-----------------------------------------
I'm not sure we can make JobInProgress.numSpeculative{Maps|Reduces} stick...
the number of speculative tasks is very dynamic(depends on progress of other
tasks, overall job progress etc.).
Having said that, the fix for this issue *is* to move hasSpeculativeTask to
JobInProgress.
> CapacityScheduler.TaskSchedulingMgr.hasSpeculativeTask bypasses HADOOP-2141
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-725
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-725
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Arun C Murthy
> Priority: Critical
>
> CapacityScheduler.TaskSchedulingMgr.hasSpeculativeTask has a duplicate of the
> old speculation code (pre HADOOP-2141) which needs to be fixed in-order for
> speculation to work correctly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
