Geoffrey Jacoby created PHOENIX-5442:
----------------------------------------
Summary: Change Detection Capture
Key: PHOENIX-5442
URL: https://issues.apache.org/jira/browse/PHOENIX-5442
Project: Phoenix
Issue Type: New Feature
Reporter: Geoffrey Jacoby
Assignee: Geoffrey Jacoby
Create a change detection capture framework for Phoenix to allow for changes to
tables to be streamed to a message bus such as Kafka. This is an umbrella JIRA,
and will require several subcomponents, such as
* Phoenix schema information annotated into HBase WALs
* The ability to generate Avro (or similar) schemas for Phoenix objects using
the above schema information
* An HBase replication endpoint that tails HBase WALs, formats the data changes
as Avro using the schema information, and then persists to a message bus. Parts
of the implementation might work better as part of the connectors repo, or some
other repo, to avoid importing too many new dependencies into Phoenix proper.
Code will depend on interfaces wherever possible so that different technologies
can be used for the message format and message bus.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
