[
https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618144#comment-14618144
]
Li Bo commented on HDFS-8719:
-----------------------------
Thanks Walter for the review.
{{remainingBytes}} will be not 1 because streamer writes data chunk by
chunk(512 bytes). If the last packet is not full, it will be enqueued in
{{closeImpl()}}, and {{enqueueCurrentPacket()}} is called, not
{{enqueueCurrentPacketFull}}. I will update the patch later.
> Erasure Coding: client generates too many small packets when writing parity
> data
> --------------------------------------------------------------------------------
>
> Key: HDFS-8719
> URL: https://issues.apache.org/jira/browse/HDFS-8719
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Li Bo
> Assignee: Li Bo
> Attachments: HDFS-8719-001.patch
>
>
> Typically a packet is about 64K, but when writing parity data, many small
> packets with size 512 bytes are generated. This may slow the write speed and
> increase the network IO.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
