[
https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-3350:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this.
> distcp should permit users to limit the number of maps
> ------------------------------------------------------
>
> Key: HADOOP-3350
> URL: https://issues.apache.org/jira/browse/HADOOP-3350
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Fix For: 0.18.0
>
> Attachments: 3350-0.patch, 3350-1.patch
>
>
> distcp provides no user-configurable setting to affect the number of maps run
> during a copy. For large clusters, the current calculation- min(#bytes /
> 256MB, #nodes * 20)- can be overly aggressive.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
