[
https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17895988#comment-17895988
]
Galen Warren commented on FLINK-36455:
--------------------------------------
[~arvid] Thanks for this! Do you think this will be backported into any 1.x
releases or is this just for 2.0?
> Sink should commit everything on notifyCheckpointCompleted
> ----------------------------------------------------------
>
> Key: FLINK-36455
> URL: https://issues.apache.org/jira/browse/FLINK-36455
> Project: Flink
> Issue Type: Bug
> Components: API / Core
> Reporter: Arvid Heise
> Assignee: Arvid Heise
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.0.0
>
>
> Currently, we retry committables at some time later until they eventually
> succeed.
> However, that violates the contract of notifyCheckpointCompleted which states
> that all side effect must be committed before returning the method. In
> particular, notifyCheckpointCompleted must fail if we cannot guarantee that
> all side effects are committed for final checkpoints. As soon as
> notifyCheckpointCompleted returns, the final checkpoint is deemed completed,
> which currently may mean that some transactions are still open.
> The solution is that all retries must happen in a close loop in
> notifyCheckpointCompleted.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)