[ 
https://issues.apache.org/jira/browse/BEAM-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161608#comment-17161608
 ] 

Boyuan Zhang commented on BEAM-6868:
------------------------------------

It's not a regression. Without bundle finalization, X-lang KafkaIO can still 
read records as expected. The only difference is X-lang KafkaIO cannot finalize 
CheckpointMark without support of bundle finalization. If the kafka consumer is 
not configured with read_commit nor auto-commit, the pipeline may produce 
duplicates when restarting the pipeline without finalizing CheckpointMark.

> Flink runner supports Bundle Finalization
> -----------------------------------------
>
>                 Key: BEAM-6868
>                 URL: https://issues.apache.org/jira/browse/BEAM-6868
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-flink
>            Reporter: Boyuan Zhang
>            Priority: P1
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to