[
https://issues.apache.org/jira/browse/HBASE-27529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viraj Jasani updated HBASE-27529:
---------------------------------
Summary: Provide RS coproc ability to attach WAL extended attributes to
mutations at replication sink (was: Attach WAL extended attributes to
mutations at replication sink)
> Provide RS coproc ability to attach WAL extended attributes to mutations at
> replication sink
> --------------------------------------------------------------------------------------------
>
> Key: HBASE-27529
> URL: https://issues.apache.org/jira/browse/HBASE-27529
> Project: HBase
> Issue Type: Improvement
> Reporter: Viraj Jasani
> Assignee: Viraj Jasani
> Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
>
>
> HBase provides coproc ability to enhance WALKey attributes (a.k.a. WAL
> annotations) in order for the replication sink cluster to build required
> metadata with the mutations. The endpoint is preWALAppend(). This ability was
> provided by HBASE-22622. The map of extended attributes is optional and hence
> not directly used by hbase internally.
> For any hbase downstreamers to build CDC (Change Data Capture) like
> functionality, it might required additional metadata in addition to the ones
> being used by hbase already (replication scope, list of cluster ids, seq id,
> table name, region id etc). For instance, Phoenix uses many additional
> attributes like tenant id, schema name, table type etc.
> We already have this extended map of attributes available in WAL protobuf, to
> provide us the capability to (de)serialize it. While creating new
> ReplicateWALEntryRequest from the list of WAL entires, we are able to
> serialize the additional attributes. Similarly, at the replication sink side,
> the deserialized WALEntry has the extended attributes available.
> At the sink cluster, we should be able to attach the deserialized extended
> attributes to the newly generated mutations so that the peer cluster can
> utilize the mutation attributes to re-build required metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
