Hello Alexey Serbin, Kudu Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/19909
to look at the new patch set (#3).
Change subject: [duplication] KUDU-3290 Support write ops to kafka with kafka
client
......................................................................
[duplication] KUDU-3290 Support write ops to kafka with kafka client
This patch is the first patch for duplication, it includes:
1. adding 2 thirdparty libraries: cppkafka, librdkafka.
librdkfka supports c language apis to operate kafka, and
cppkafka is a C++ wrapper for librdkakfa, its an api sugger.
2. Duplicator: write records to kafka
As my plans, I will commit about 9 commits for duplication.
1. Support write ops to kafka with kafka client
2. Add a new raft role DUPLICATOR and raft processing
3. registe kafka uri and validate and unregiste
4. recovering duplication when a leader switches
5. creating/altering in server-side for duplication
6. cpp client apis and CLI tool
7. java client apis
8. suppports kerberos
9. alter a duplication
During this progressing, plans maybe adjust according to advices.
Change-Id: Icbd5738a61d2521b363c628f88e3699879920a49
---
M CMakeLists.txt
A cmake_modules/FindCppKafka.cmake
A cmake_modules/FindRdKafka.cmake
M src/kudu/common/types-test.cc
M src/kudu/common/types.cc
M src/kudu/common/types.h
M src/kudu/consensus/consensus.proto
M src/kudu/consensus/metadata.proto
A src/kudu/duplicator/CMakeLists.txt
A src/kudu/duplicator/connector.cc
A src/kudu/duplicator/connector.h
A src/kudu/duplicator/connector_manager.h
A src/kudu/duplicator/duplicator.cc
A src/kudu/duplicator/duplicator.h
A src/kudu/duplicator/kafka/kafka.proto
A src/kudu/duplicator/kafka/kafka_connector-test.cc
A src/kudu/duplicator/kafka/kafka_connector.cc
A src/kudu/duplicator/kafka/kafka_connector.h
A src/kudu/integration-tests/single_broker_kafka.h
A src/kudu/scripts/kafka-simple-control.sh
M src/kudu/tablet/CMakeLists.txt
M src/kudu/tablet/ops/write_op.h
M src/kudu/tablet/tablet.h
M src/kudu/tablet/tablet_replica.cc
M src/kudu/tablet/tablet_replica.h
M src/kudu/tserver/tablet_server.cc
M src/kudu/tserver/tablet_server.h
M src/kudu/tserver/ts_tablet_manager.cc
M src/kudu/tserver/ts_tablet_manager.h
M thirdparty/build-definitions.sh
M thirdparty/build-thirdparty.sh
M thirdparty/download-thirdparty.sh
M thirdparty/vars.sh
33 files changed, 2,126 insertions(+), 21 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/09/19909/3
--
To view, visit http://gerrit.cloudera.org:8080/19909
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Icbd5738a61d2521b363c628f88e3699879920a49
Gerrit-Change-Number: 19909
Gerrit-PatchSet: 3
Gerrit-Owner: Yuqi Du <[email protected]>
Gerrit-Reviewer: Alexey Serbin <[email protected]>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Yuqi Du <[email protected]>
