[
https://issues.apache.org/jira/browse/HUDI-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456081#comment-17456081
]
sivabalan narayanan edited comment on HUDI-1280 at 12/9/21, 1:21 AM:
---------------------------------------------------------------------
[~vbalaji] : We already have a config to auto resetting offsets in kafka. Or
are you referring to something else. can you throw some light please.
was (Author: shivnarayan):
[~Trevorzhang] : We already have a config to auto resetting offsets in kafka.
would that work for you or are you referring to something else. can you throw
some light please.
> Add tool to capture earliest or latest offsets in kafka topics
> ---------------------------------------------------------------
>
> Key: HUDI-1280
> URL: https://issues.apache.org/jira/browse/HUDI-1280
> Project: Apache Hudi
> Issue Type: Improvement
> Components: DeltaStreamer
> Reporter: Balaji Varadarajan
> Assignee: Trevorzhang
> Priority: Major
> Fix For: 0.11.0
>
>
> For bootstrapping cases using spark.write(), we need to capture offsets from
> kafka topic and use it as checkpoint for subsequent read from Kafka topics.
>
> [https://github.com/apache/hudi/issues/1985]
> We need to build this integration for smooth transition to deltastreamer.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
