[
https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995353#comment-16995353
]
Anoop Sam John commented on HBASE-23286:
----------------------------------------
Nice numbers [~zghao].. So here per each of the 20 WAL files, we generate
HFiles under region:cf. So the issue of too many tiny HFiles u mentioned in
the design doc, how/whether that affects? It will generate many compaction
requests? Or as a whole one compaction for all the tiny HFiles (obviously if
this number< max files to compact config)
> Improve MTTR: Split WAL to HFile
> --------------------------------
>
> Key: HBASE-23286
> URL: https://issues.apache.org/jira/browse/HBASE-23286
> Project: HBase
> Issue Type: Improvement
> Components: MTTR
> Reporter: Guanghao Zhang
> Assignee: Guanghao Zhang
> Priority: Major
>
> After HBASE-20724, the compaction event marker is not used anymore when
> failover. So our new proposal is split WAL to HFile to imporve MTTR. It has 3
> steps:
> # Read WAL and write HFile to region’s column family’s recovered.hfiles
> directory.
> # Open region.
> # Bulkload the recovered.hfiles for every column family.
> The design doc was attathed by a google doc. Any suggestions are welcomed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
