[
https://issues.apache.org/jira/browse/HADOOP-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16015234#comment-16015234
]
Yongjun Zhang edited comment on HADOOP-14407 at 5/18/17 5:39 AM:
-----------------------------------------------------------------
Hi [~omkarksa],
Thanks [~ajisakaa] for pointing out that the build was using the "jpg" file you
uploaded as the patch (precommit jenkins job chose the most recent attached
file as the patch), thus the test failed. I uoloaded the patch rev2 again, and
it triggered a new run. And the result shows checkstyle issues I commented
earlier.
https://builds.apache.org/job/PreCommit-HADOOP-Build/12351/artifact/patchprocess/diff-checkstyle-hadoop-tools_hadoop-distcp.txt
Would you please address them and upload a new rev?
Thanks.
was (Author: yzhangal):
Hi [~omkarksa],
Thanks [~ajisakaa] for pointing out that the build was using the "jpg" file you
uploaded as the patch, thus the test failed. I uoloaded the patch rev2 again,
and it triggered a new run. And the result shows checkstyle issues I commented
earlier.
https://builds.apache.org/job/PreCommit-HADOOP-Build/12351/artifact/patchprocess/diff-checkstyle-hadoop-tools_hadoop-distcp.txt
Would you please address them and upload a new rev?
Thanks.
> DistCp - Introduce a configurable copy buffer size
> --------------------------------------------------
>
> Key: HADOOP-14407
> URL: https://issues.apache.org/jira/browse/HADOOP-14407
> Project: Hadoop Common
> Issue Type: Improvement
> Components: tools/distcp
> Affects Versions: 2.9.0
> Reporter: Omkar Aradhya K S
> Assignee: Omkar Aradhya K S
> Fix For: 2.9.0, 3.0.0-alpha3
>
> Attachments: HADOOP-14407.001.patch, HADOOP-14407.002.patch,
> HADOOP-14407.002.patch, TotalTime-vs-CopyBufferSize.jpg
>
>
> Currently, the RetriableFileCopyCommand has a fixed copy buffer size of just
> 8KB. We have noticed in our performance tests that with bigger buffer sizes
> we saw upto ~3x performance boost. Hence, making the copy buffer size a
> configurable setting via the new parameter <copybuffersize>.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
