[
https://issues.apache.org/jira/browse/HBASE-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Stack updated HBASE-21588:
----------------------------------
Release Note:
After HBASE-21588, we introduce a new way to do WAL splitting coordination by
procedure framework. This can simplify the process of WAL splitting and no need
to connect zookeeper any more.
During ServerCrashProcedure, it will create a SplitWALProcedure for each WAL
that needs to split. Then each SplitWALProcedure will spawn a
SplitWALRemoteProcedure to send the request to regionserver.
At the RegionServer side, whole split process is handled by a SplitWALCallable.
It splits the WAL and returns the result to the master.
According to my test, this patch has a better performance as the number of WALs
that need to split increase. And it can relieve the pressure on zookeeper.
Set 'hbase.split.wal.zk.coordinated' to false to 'enable'.
'hbase.regionserver.wal.max.splitters' is reused to set how many 'splitters' to
run on the RegionServer side.
was:
After HBASE-21588, we introduce a new way to do WAL splitting coordination by
procedure framework. This can simplify the process of WAL splitting and no need
to connect zookeeper any more.
During ServerCrashProcedure, it will create a SplitWALProcedure for each WAL
that need to split. Then each SplitWALProcedure will spawn a
SplitWALRemoteProcedure to send the request to regionserver.
At the RegionServer side, whole process is handled by SplitWALCallable. It
split the WAL and return the result to master.
According to my test, this patch has a better performance as the number of WALs
that need to split increase. And it can relieve the pressure on zookeeper.
Set 'hbase.split.wal.zk.coordinated' to false to enable.
> Procedure v2 wal splitting implementation
> -----------------------------------------
>
> Key: HBASE-21588
> URL: https://issues.apache.org/jira/browse/HBASE-21588
> Project: HBase
> Issue Type: Sub-task
> Affects Versions: 3.0.0-alpha-1, 2.2.0
> Reporter: Jingyun Tian
> Assignee: Jingyun Tian
> Priority: Major
> Fix For: 3.0.0-alpha-1, 2.2.0
>
> Attachments: HBASE-21588.branch-2.001.patch,
> HBASE-21588.branch-2.002.patch, HBASE-21588.master.003.patch,
> HBASE-21588.master.004.patch, HBASE-21588.master.005.patch,
> HBASE-21588.master.006.patch, HBASE-21588.master.007.patch,
> HBASE-21588.master.008.patch, HBASE-21588.master.009.patch,
> HBASE-21588.master.010.patch, HBASE-21588.master.011.patch,
> HBASE-21588.master.012.patch, HBASE-21588.master.013.patch,
> HBASE-21588.master.014.patch, HBASE-21588.master.015.patch,
> HBASE-21588.master.016.patch, HBASE-21588.master.017.patch,
> HBASE-21588.master.018.patch, HBASE-21588.master.018.patch,
> HBASE-21588.master.019.patch, HBASE-21588.master.019.patch,
> HBASE-21588.master.020.patch
>
>
> create a sub task to submit the implementation of procedure v2 wal splitting
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
