[
https://issues.apache.org/jira/browse/HADOOP-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Gummadi updated HADOOP-5572:
---------------------------------
Attachment: HADOOP-5572.v1.4.patch
In Merger, removed reliance on writesCounter to determine if the final merge
needs to be included as part of sort phase in the calculation by adding a new
static method for setting this boolean variable includeFinalMerge.
Also made code changes such that web UI now shows "Map Phase Finished" time for
map tasks.
Please review and provide your comments.
> The map progress value should have a separate phase for doing the final sort.
> -----------------------------------------------------------------------------
>
> Key: HADOOP-5572
> URL: https://issues.apache.org/jira/browse/HADOOP-5572
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Owen O'Malley
> Assignee: Ravi Gummadi
> Attachments: HADOOP-5572.patch, HADOOP-5572.v1.1.patch,
> HADOOP-5572.v1.2.patch, HADOOP-5572.v1.3.patch, HADOOP-5572.v1.4.patch,
> HADOOP-5572.v1.patch
>
>
> Currently, the final spill and sort doesn't record any progress while it
> runs, leading to the perception that the map is done, but "stuck".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
