[
https://issues.apache.org/jira/browse/HBASE-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Stack updated HBASE-21588:
----------------------------------
Release Note:
After HBASE-21588, we introduce a new way to do WAL splitting coordination by
procedure framework. This can simplify the process of WAL splitting and no need
to connect zookeeper any more.
During ServerCrashProcedure, it will create a SplitWALProcedure for each WAL
that need to split. Then each SplitWALProcedure will spawn a
SplitWALRemoteProcedure to send the request to regionserver.
At the RegionServer side, whole process is handled by SplitWALCallable. It
split the WAL and return the result to master.
According to my test, this patch has a better performance as the number of WALs
that need to split increase. And it can relieve the pressure on zookeeper.
Set 'hbase.split.wal.zk.coordinated' to false to enable.
was:
After HBASE-21588, we introduce a new way to do WAL splitting coordination by
procedure framework. This can simplify the process of WAL splitting and no need
to connect zookeeper any more.
During ServerCrashProcedure, it will create a SplitWALProcedure for each WAL
that need to split. Then each SplitWALProcedure will spawn a
SplitWALRemoteProcedure to send the request to regionserver.
At the RegionServer side, whole process is handled by SplitWALCallable. It
split the WAL and return the result to master.
According to my test, this patch has a better performance as the number of WALs
that need to split increase. And it can relieve the pressure on zookeeper.
> Procedure v2 wal splitting implementation
> -----------------------------------------
>
> Key: HBASE-21588
> URL: https://issues.apache.org/jira/browse/HBASE-21588
> Project: HBase
> Issue Type: Sub-task
> Affects Versions: 3.0.0-alpha-1, 2.2.0
> Reporter: Jingyun Tian
> Assignee: Jingyun Tian
> Priority: Major
> Fix For: 3.0.0-alpha-1, 2.2.0
>
> Attachments: HBASE-21588.branch-2.001.patch,
> HBASE-21588.branch-2.002.patch, HBASE-21588.master.003.patch,
> HBASE-21588.master.004.patch, HBASE-21588.master.005.patch,
> HBASE-21588.master.006.patch, HBASE-21588.master.007.patch,
> HBASE-21588.master.008.patch, HBASE-21588.master.009.patch,
> HBASE-21588.master.010.patch, HBASE-21588.master.011.patch,
> HBASE-21588.master.012.patch, HBASE-21588.master.013.patch,
> HBASE-21588.master.014.patch, HBASE-21588.master.015.patch,
> HBASE-21588.master.016.patch, HBASE-21588.master.017.patch,
> HBASE-21588.master.018.patch, HBASE-21588.master.018.patch,
> HBASE-21588.master.019.patch, HBASE-21588.master.019.patch,
> HBASE-21588.master.020.patch
>
>
> create a sub task to submit the implementation of procedure v2 wal splitting
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
