[
https://issues.apache.org/jira/browse/FLINK-29856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mason Chen updated FLINK-29856:
-------------------------------
Description:
When I trigger a savepoint with the Flink K8s operator, I verified for two
sources (KafkaSource and MultiClusterKafkaSource) do not invoke
notifyCheckpointComplete. This is easily reproducible in a simple pipeline
(e.g. KafkaSource -> print). In this case, the savepoint is complete and
successful, which is verified by the Flink Checkpoint UI tab and the jobmanager
logs. e.g. `
Triggering checkpoint 3 (type=SavepointType\{name='Savepoint',
postCheckpointAction=NONE, formatType=CANONICAL})`
However, when the checkpoint occurs via the interval, I do see the sources
checkpointing properly and expected logs in the output.
After the ticket was initially filed, I also checked with other stateful UDFs
and observed the same behavior.
was:
When I trigger a savepoint with the Flink K8s operator, I verified for two
sources (KafkaSource and MultiClusterKafkaSource) do not invoke
notifyCheckpointComplete. This is easily reproducible in a simple pipeline
(e.g. KafkaSource -> print). In this case, the savepoint is complete and
successful, which is verified by the Flink Checkpoint UI tab and the jobmanager
logs. e.g. `
Triggering checkpoint 3 (type=SavepointType\{name='Savepoint',
postCheckpointAction=NONE, formatType=CANONICAL})`
However, when the checkpoint occurs via the interval, I do see the sources
checkpointing properly and expected logs in the output.
After the ticket was initially filed, I also checked with other stateful UDFs.
> Triggering savepoint does not trigger operator notifyCheckpointComplete
> -----------------------------------------------------------------------
>
> Key: FLINK-29856
> URL: https://issues.apache.org/jira/browse/FLINK-29856
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Checkpointing
> Affects Versions: 1.16.0
> Reporter: Mason Chen
> Priority: Major
>
> When I trigger a savepoint with the Flink K8s operator, I verified for two
> sources (KafkaSource and MultiClusterKafkaSource) do not invoke
> notifyCheckpointComplete. This is easily reproducible in a simple pipeline
> (e.g. KafkaSource -> print). In this case, the savepoint is complete and
> successful, which is verified by the Flink Checkpoint UI tab and the
> jobmanager logs. e.g. `
> Triggering checkpoint 3 (type=SavepointType\{name='Savepoint',
> postCheckpointAction=NONE, formatType=CANONICAL})`
>
> However, when the checkpoint occurs via the interval, I do see the sources
> checkpointing properly and expected logs in the output.
> After the ticket was initially filed, I also checked with other stateful UDFs
> and observed the same behavior.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
