[ https://issues.apache.org/jira/browse/FLINK-30238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17697246#comment-17697246 ]
Yun Gao commented on FLINK-30238: --------------------------------- Hi [~agg_neha07] I think the change of intermediate savepoint (namely the ones not triggered by stop-with-savepoint) comes from the modification to skip savepoint for recovery: [https://cwiki.apache.org/confluence/display/FLINK/FLIP-193%3A+Snapshots+ownership,] which is merged in 1.15. With this modification the intermediate savepoint will only do snapshots and will not commit side-effect. May I have a double confirmation about the detailed issue that the change caused issues for the delta sink pipeline? > Unified Sink committer does not clean up state on final savepoint > ----------------------------------------------------------------- > > Key: FLINK-30238 > URL: https://issues.apache.org/jira/browse/FLINK-30238 > Project: Flink > Issue Type: Bug > Components: Connectors / Common > Affects Versions: 1.17.0, 1.15.3, 1.16.1 > Reporter: Fabian Paul > Priority: Critical > > During stop-with-savepoint the committer only commits the pending > committables on notifyCheckpointComplete. > This has several downsides. > * Last committableSummary has checkpoint id LONG.MAX and is never cleared > from the state leading to that stop-with-savepoint does not work when the > pipeline recovers from a savepoint > * While the committables are committed during stop-with-savepoint they are > not forwarded to post-commit topology, potentially losing data and preventing > to close open transactions. -- This message was sent by Atlassian Jira (v8.20.10#820010)