Yutong Xiao created HBASE-29027: ----------------------------------- Summary: Introduce a new WALProvider to generate WAL files consumed by Replication Key: HBASE-29027 URL: https://issues.apache.org/jira/browse/HBASE-29027 Project: HBase Issue Type: Improvement Components: Replication, wal Reporter: Yutong Xiao Assignee: Yutong Xiao
Under our current Replication implementation, all WAL files will be consumed and the data will be filtered by a table attribute REPLICATION_SCOPE_GLOBAL We are using 2.4.11 version in our production env. And we have a small group table to use the replication to do CDC, however with the growth of the number of other non-replicated tables, we met the log queue accumulation issue and the data lag grew to hours level. To solve the issue we write the tables, which has CF marked the replication_scope to global, to separated WAL files and let the replication only consume those files. The feature works good in our env and push it to the community. -- This message was sent by Atlassian Jira (v8.20.10#820010)