[
https://issues.apache.org/jira/browse/HADOOP-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597228#action_12597228
]
Tsz Wo (Nicholas), SZE commented on HADOOP-3350:
------------------------------------------------
+1 patch looks good
> distcp should permit users to limit the number of maps
> ------------------------------------------------------
>
> Key: HADOOP-3350
> URL: https://issues.apache.org/jira/browse/HADOOP-3350
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Chris Douglas
> Assignee: Chris Douglas
> Fix For: 0.18.0
>
> Attachments: 3350-0.patch, 3350-1.patch
>
>
> distcp provides no user-configurable setting to affect the number of maps run
> during a copy. For large clusters, the current calculation- min(#bytes /
> 256MB, #nodes * 20)- can be overly aggressive.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.