This is an automated email from the ASF dual-hosted git repository. kuyu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git
The following commit(s) were added to refs/heads/master by this push: new 7b9c7cb [GOBBLIN-1102] Add link to GIP[] 7b9c7cb is described below commit 7b9c7cbbff76c6963576846b81bfdae8ced4ba22 Author: vbohra <vbo...@linkedin.com> AuthorDate: Tue Mar 31 10:05:40 2020 -0700 [GOBBLIN-1102] Add link to GIP[] Closes #2943 from vikrambohra/GOBBLIN-1102 --- gobblin-docs/developer-guide/HighLevelConsumer.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/gobblin-docs/developer-guide/HighLevelConsumer.md b/gobblin-docs/developer-guide/HighLevelConsumer.md index 3f229b7..e2799b9 100644 --- a/gobblin-docs/developer-guide/HighLevelConsumer.md +++ b/gobblin-docs/developer-guide/HighLevelConsumer.md @@ -6,6 +6,8 @@ Problem Statement Current Gobblin Kafka [`High Level Consumer`](https://github.com/apache/incubator-gobblin/blob/master/gobblin-runtime/src/main/java/org/apache/gobblin/runtime/kafka/HighLevelConsumer.java) uses Kafka Consumer (0.8) APIs and gobblin support for them will be deprecated. The Re-design's primary goal is to replace old kafka consumer APIs like [`ConsumerConnector`](https://archive.apache.org/dist/kafka/0.8.2.2/scaladoc/index.html#kafka.consumer.ConsumerConnector) and [`MessageAndMetadata`](ht [...] Additionally, the old design uses kafka auto commit feature which can cause potential loss of messages when offsets are committed and the system fails before messages are processed. +Detailed design and implementation details can be found [here](https://cwiki.apache.org/confluence/display/GOBBLIN/GIP+5%3A+High+Level+Consumer+Re-design) + New Design & Details ====================