[
https://issues.apache.org/jira/browse/HDFS-14844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929495#comment-16929495
]
Íñigo Goiri commented on HDFS-14844:
------------------------------------
The description is much more clear now.
Minor tune up:
The output stream buffer size of a DFSClient remote read. The buffer default
value is 8KB. The buffer includes only
some request parameters that are: block, blockToken, clientName, startOffset,
len, verifyChecksum, cachingStrategy.
It is recommended to adjust the value according to the workload, which can
reduce unnecessary memory usage
and the frequency of the garbage collection. A value of 512 might be reasonable.
As we are also changing, let's also go with the minor format change:
{code}
int bufferSize = configuration.getInt(
DFS_CLIENT_BLOCK_READER_REMOTE_BUFFER_SIZE_KEY,
DFS_CLIENT_BLOCK_READER_REMOTE_BUFFER_SIZE_DEFAULT);
{code}
> Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream
> configurable
> ----------------------------------------------------------------------------------
>
> Key: HDFS-14844
> URL: https://issues.apache.org/jira/browse/HDFS-14844
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Lisheng Sun
> Assignee: Lisheng Sun
> Priority: Minor
> Attachments: HDFS-14844.001.patch, HDFS-14844.002.patch,
> HDFS-14844.003.patch
>
>
> details for HDFS-14820
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
