Fix average progress calculation in speculative execution of maps + fix pending
issues in speculative execution of reduces
--------------------------------------------------------------------------------------------------------------------------
Key: HADOOP-741
URL: http://issues.apache.org/jira/browse/HADOOP-741
Project: Hadoop
Issue Type: Bug
Components: mapred
Reporter: Sanjay Dahiya
This issue addresses following
1. Avg progress in speculative execution of map tasks should not divide /
maps.length again in JonInProgress.java:331
2. Normal tasks should get priority over speculative tasks in reduce.
JobInProgress.findNewTask should not break if a spec task is found.
3. Delete directories used by PhasedFileSystem irrespective of whether
speculative execution is enable to allow tasks to use PhasedFileSystem
independently.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira