[
https://issues.apache.org/jira/browse/HBASE-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15603908#comment-15603908
]
Duo Zhang commented on HBASE-15709:
-----------------------------------
Yeah the datanode only aceept a packet starting from a checksum boundary, so if
we break at a point which is not the checksum boundary, then we need to also
include the data to the previous checksum boundary when sending the next
packet. And thanks for the remind, I think I need to make sure the MAX_DATA_LEN
is aligned with the checksum chunk size. Will upload a new patch and commit it
if the precommit result is OK.
Thanks.
> Handle large edits for asynchronous WAL
> ---------------------------------------
>
> Key: HBASE-15709
> URL: https://issues.apache.org/jira/browse/HBASE-15709
> Project: HBase
> Issue Type: Sub-task
> Components: io, wal
> Affects Versions: 2.0.0
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15709-v1.patch, HBASE-15709.patch
>
>
> First, FanOutOneBlockAsyncDFSOutput can not work if the buffered data is
> larger than PacketReceiver.MAX_PACKET_SIZE(16MB).
> Second, since we only allow one block here, we need to make sure we do not
> exceed the block size after writing a large chunk of data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
