Fix some corner case issues in speculative execution (post hadoop-2141)
-----------------------------------------------------------------------
Key: MAPREDUCE-717
URL: https://issues.apache.org/jira/browse/MAPREDUCE-717
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Affects Versions: 0.21.0
Reporter: Devaraj Das
Assignee: Devaraj Das
Fix For: 0.21.0
Some corner case issues can be fixed:
1) Setup task should not add anything to the job statistics (since they are
really fast and might affect the statistics of a job with few tasks)
2) The statistics computations should be guarded for cases where things like
sumOfSquares could become less than zero (due to rounding errors mostly).
3) The method TaskInProgress.getCurrentProgressRate() should take into account
the COMMIT_PENDING state
4) The testcase TestSpeculativeExecution.testTaskLATEScheduling could be made
more robust
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
