[
https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-3350:
----------------------------------
Attachment: 3350-0.patch
This retains the existing behavior by default, but observes a
"distcp.max.map.tasks" parameter.
> distcp should permit users to limit the number of maps
> ------------------------------------------------------
>
> Key: HADOOP-3350
> URL: https://issues.apache.org/jira/browse/HADOOP-3350
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Chris Douglas
> Fix For: 0.18.0
>
> Attachments: 3350-0.patch
>
>
> distcp provides no user-configurable setting to affect the number of maps run
> during a copy. For large clusters, the current calculation- min(#bytes /
> 256MB, #nodes * 20)- can be overly aggressive.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
