[
https://issues.apache.org/jira/browse/HDFS-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954546#comment-15954546
]
Anu Engineer commented on HDFS-11006:
-------------------------------------
from this page - https://developers.google.com/protocol-buffers/docs/techniques
{noformat}
Protocol Buffers are not designed to handle large messages.
As a general rule of thumb, if you are dealing in messages larger than a
megabyte each,
it may be time to consider an alternate strategy.
{noformat}
So I would think that anything more than 1 MB, we should be chunking
automatically or just use 1 MB as the hard coded value as PB documentation
suggests.
> Ozone: support setting chunk size in streaming API
> --------------------------------------------------
>
> Key: HDFS-11006
> URL: https://issues.apache.org/jira/browse/HDFS-11006
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Affects Versions: HDFS-7240
> Reporter: Anu Engineer
> Assignee: Yiqun Lin
> Attachments: HDFS-11006-HDFS-7240.001.patch,
> HDFS-11006-HDFS-7240.002.patch
>
>
> Right now we have a hard coded chunk size, we should either have this read
> from config or the user should be able to pass this to ChunkInputStream
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
