[
https://issues.apache.org/jira/browse/HDFS-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595554#comment-13595554
]
Mark Wagner commented on HDFS-4551:
-----------------------------------
I haven't done any real testing for different values of io.file.buffer.size,
but it seemed that 4KB and 64KB had similar performance (at least when pulling
over WebHDFS). They may be different under load, though. I can look at this
more, but I think determining a good value for that parameter is outside the
scope of this JIRA. Would you agree?
> Change WebHDFS buffersize behavior to improve default performance
> -----------------------------------------------------------------
>
> Key: HDFS-4551
> URL: https://issues.apache.org/jira/browse/HDFS-4551
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: webhdfs
> Affects Versions: 1.1.2
> Reporter: Mark Wagner
> Assignee: Mark Wagner
> Attachments: HDFS-4551.1.patch
>
>
> Currently on 1.X branch, the buffer size used to copy bytes to network
> defaults to io.file.buffer.size. This causes performance problems if that
> buffersize is large.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
