[
https://issues.apache.org/jira/browse/HBASE-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160327#comment-17160327
]
Bo Cui edited comment on HBASE-23634 at 7/18/20, 4:01 AM:
----------------------------------------------------------
1、before compaction, large number of small hfiles affect read and write
performance of region
2、a hfile needs 3 NN RPCs to bulkload during
openRegion(validate、rename、createReader)
if bulkLoadService ThreadNum is 3, and hfiles is 20(because wal number is 20),
and RS is 100, region is 2K*100, and openRegion thread is 75
so hbase needs 3*3*75*100 concurrent NN RPCs and needs 3*20*2K*100 total NN RPCs
was (Author: bo cui):
1、before compaction, large number of small hfiles affect read and write
performance of region
2、a hfile needs 3 NN RPCs to bulkload during
openRegion(validate、rename、createReader)
if bulkLoadService ThreadNum is 3, and hfiles is 20(because wal number is 20),
and RS is 100, region is 2K*100, and openRegion thread is 75
so hbase needs 3*3*75*100 concurrent NN RPCs and needs 3*20*2K*100 NN total NN
RPCs
> Enable "Split WAL to HFile" by default
> --------------------------------------
>
> Key: HBASE-23634
> URL: https://issues.apache.org/jira/browse/HBASE-23634
> Project: HBase
> Issue Type: Task
> Affects Versions: 3.0.0-alpha-1, 2.3.0
> Reporter: Guanghao Zhang
> Priority: Blocker
> Fix For: 3.0.0-alpha-1, 2.4.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
