Viraj Jasani created HBASE-27529:
------------------------------------
Summary: Attach WAL extended attributes to mutations at
replication sink
Key: HBASE-27529
URL: https://issues.apache.org/jira/browse/HBASE-27529
Project: HBase
Issue Type: Improvement
Reporter: Viraj Jasani
Assignee: Viraj Jasani
Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.16, 2.5.3
HBase provides coproc ability to enhance WALKey attributes (a.k.a. WAL
annotations) in order for the replication sink cluster to build required
metadata with the mutations. The endpoint is preWALAppend(). This ability was
provided by HBASE-22622. The map of extended attributes is optional and hence
not directly used by hbase internally.
For any hbase downstreamers to build CDC (Change Data Capture) like
functionality, it might required additional metadata in addition to the ones
being used by hbase already (replication scope, list of cluster ids, seq id,
table name, region id etc). For instance, Phoenix uses many additional
attributes like tenant id, schema name, table type etc.
We already have this extended map of attributed available in WAL protobuf, to
provide us the capability to (de)serialize it. While creating new
ReplicateWALEntryRequest from the list of WAL entires, we are able to serialize
the additional attributes. Similarly, at the replication sink side, the
deserialized WALEntry has the extended attributed available.
At the sink cluster, we should be able to attach the deserialized extended
attributes to the newly generated mutations so that the peer cluster can
utilize the mutation attributes to re-build required metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
