Geoffrey Jacoby created PHOENIX-5449:
----------------------------------------
Summary: Schema-aware Message Consumer
Key: PHOENIX-5449
URL: https://issues.apache.org/jira/browse/PHOENIX-5449
Project: Phoenix
Issue Type: Sub-task
Reporter: Geoffrey Jacoby
Assignee: Geoffrey Jacoby
The change data capture ReplicationEndpoint will be persisting data to the
message bus using a low-level, generic schema that includes a pointer to schema
information, plus a list of Cells (like an Avro-encoded WAL Entry).
This is done both because some low-level use cases such as backup don't the
strong typing until restore-time, but also to simplify the endpoint and improve
performance. The endpoint will be decoupled from any consumer that wants to do
higher level processing on any entity type.
There will be a need, however, for a message bus consumer that reads in the
low-level messages from the ReplicationEndpoint, looks up the schema using the
metadata in the message and the API in PHOENIX-5443, and then "rehydrates" the
low-level message into a higher-level, strongly-typed message suitable for
running business logic on.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)