Andrew Purtell created HBASE-15320:
--------------------------------------
Summary: HBase connector for Kafka Connect
Key: HBASE-15320
URL: https://issues.apache.org/jira/browse/HBASE-15320
Project: HBase
Issue Type: New Feature
Reporter: Andrew Purtell
Fix For: 2.0.0
Implement an HBase connector with source and sink tasks for the Connect
framework (http://docs.confluent.io/2.0.0/connect/index.html) available in
Kafka 0.9 and later.
See also:
http://www.confluent.io/blog/announcing-kafka-connect-building-large-scale-low-latency-data-pipelines
An HBase source
(http://docs.confluent.io/2.0.0/connect/devguide.html#task-example-source-task)
could be implemented as a WALObserver, publishing cluster wide change streams
from the WAL to one or more topics, with configurable mapping and partitioning
of table changes to topics.
An HBase sink task
(http://docs.confluent.io/2.0.0/connect/devguide.html#sink-tasks) would
persist, with optional transformation (JSON? Avro?, map fields to native
schema?), Kafka SinkRecords into HBase tables.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
