[
https://issues.apache.org/jira/browse/HBASE-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599282#comment-15599282
]
Duo Zhang commented on HBASE-15709:
-----------------------------------
[~stack] I removed this in TestMobStoreScanne where we write a WAL entry around
75MB.
{code:title=TestMobStoreScanner.java}
// TODO: AsyncFSWAL can not handle large edits right now, remove
this after we fix the issue.
TEST_UTIL.getConfiguration().set(WALFactory.WAL_PROVIDER,
"filesystem");
{code}
It passed locally which means now the AsyncFSWAL can handle entries which size
is larger than the MAX_PACKET_SIZE limit of HDFS.
> Handle large edits for asynchronous WAL
> ---------------------------------------
>
> Key: HBASE-15709
> URL: https://issues.apache.org/jira/browse/HBASE-15709
> Project: HBase
> Issue Type: Sub-task
> Components: io, wal
> Affects Versions: 2.0.0
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Critical
> Fix For: 2.0.0
>
> Attachments: HBASE-15709.patch
>
>
> First, FanOutOneBlockAsyncDFSOutput can not work if the buffered data is
> larger than PacketReceiver.MAX_PACKET_SIZE(16MB).
> Second, since we only allow one block here, we need to make sure we do not
> exceed the block size after writing a large chunk of data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
