[ 
https://issues.apache.org/jira/browse/BEAM-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829270#comment-16829270
 ] 

Thomas Weise commented on BEAM-7171:
------------------------------------

A possible solution is to replace the "finish bundle callback" with a "post 
snapshot callback" and advance the watermark only then. No additional state 
needs to be part of the snapshot, since the next watermark is certain to follow.

 

> New bundles may start within snapshotState
> ------------------------------------------
>
>                 Key: BEAM-7171
>                 URL: https://issues.apache.org/jira/browse/BEAM-7171
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>    Affects Versions: 2.11.0
>            Reporter: Thomas Weise
>            Priority: Major
>
> The Flink runner finishes bundles as part of snapshotState. In the portable 
> runner, it is possible that a new bundle will be started as part of finishing 
> the bundle when the bundleFinishedCallback is invoked. This happens when the 
> watermark advances and timers get fired.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to