[
https://issues.apache.org/jira/browse/MAPREDUCE-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siqi Li resolved MAPREDUCE-6047.
--------------------------------
Resolution: Duplicate
> Introduce localization phase for mapreduce jobs
> -----------------------------------------------
>
> Key: MAPREDUCE-6047
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6047
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Siqi Li
> Assignee: Siqi Li
>
> we have been experienced lots of task timeout due to localization of a large
> number of files. It would be great if we have an additional phase that keep
> track of how many files have been localized. Thus for Mappers we had
> "localization", "map", "sort". For backwards compatibility, we can keep it 0%
> but still heartbeat to AM with the status string "5/300 files localized".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)