[
https://issues.apache.org/jira/browse/BEAM-9977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128687#comment-17128687
]
josson paul kalapparambath edited comment on BEAM-9977 at 6/8/20, 10:21 PM:
----------------------------------------------------------------------------
[~boyuanz] . Looks like I don't need BEAM-10123. But I need few more
clarifications.
Let us say the pipeline failed and restarted.
1) WatchGrothFn will fetch *ALL* the Kafka partitions again and sends it
further down. Now, does ReadFromKafkaViaSDF get each partition and start from
where it check pointed last?.
was (Author: josson):
[~boyuanz] . Looks like I don't need BEAM-10123. But I need few more
clarifiations.
Let us say the pipeline failed and restarted.
1) WatchGrothFn will fetch *ALL* the Kafka partitions again and sends it
further down. Now, does ReadFromKafkaViaSDF get each partition and start from
where it check pointed last?.
> Build Kafka Read on top of Java SplittableDoFn
> ----------------------------------------------
>
> Key: BEAM-9977
> URL: https://issues.apache.org/jira/browse/BEAM-9977
> Project: Beam
> Issue Type: New Feature
> Components: io-java-kafka
> Reporter: Boyuan Zhang
> Assignee: Boyuan Zhang
> Priority: P2
> Time Spent: 10h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
