[
https://issues.apache.org/jira/browse/BEAM-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156412#comment-17156412
]
Boyuan Zhang commented on BEAM-6868:
------------------------------------
Just want to add more details here. Any UnboundedSource with beam_fn_api
enabled and beam_fn_api_use_deprecated_read disabled will be expanded into sdf
unbounded read, which requires bundle finalization to perform finalizing
CheckpointMark. There are ongoing works converting some IOs into SDF based,
where bundle finalization may not be required. For example, in SDF based Kafka,
we no longer use bundle finalization to commit offsets. But it's good to have
Flink runner support bundle finalization.
> Flink runner supports Bundle Finalization
> -----------------------------------------
>
> Key: BEAM-6868
> URL: https://issues.apache.org/jira/browse/BEAM-6868
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink
> Reporter: Boyuan Zhang
> Priority: P3
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
