[
https://issues.apache.org/jira/browse/HADOOP-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Gummadi updated HADOOP-5572:
---------------------------------
Attachment: HADOOP-5572.patch
This patch reserves 33.3% of map task to sort. So map task now has 2 phases:
map phase and sort phase. Progress can have different weightages for different
phases now. In map task, map phase accounts for 66.7% and sort phase 33.3%.
This patch also makes code changes needed for updating of merge progress both
on map side and reduce side.
Testing is in progress.
Please review and provide your comments.
> The map progress value should have a separate phase for doing the final sort.
> -----------------------------------------------------------------------------
>
> Key: HADOOP-5572
> URL: https://issues.apache.org/jira/browse/HADOOP-5572
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Owen O'Malley
> Assignee: Ravi Gummadi
> Attachments: HADOOP-5572.patch
>
>
> Currently, the final spill and sort doesn't record any progress while it
> runs, leading to the perception that the map is done, but "stuck".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
