[
https://issues.apache.org/jira/browse/FLINK-27481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534723#comment-17534723
]
Sebastian Mattheis commented on FLINK-27481:
--------------------------------------------
Thanks for reporting the problem. This may indeed be a bug. However, I think we
need some more information. You would help us best if you could include the
following:
* Screenshot of the jobgraph (The one with backpressure stats.) to get an
overview of the tasks
* Screenshots of operator/sub-task details of checkpointing (expand the plus
symbol in the UI) <-- If you could include this for for version 1.13.x and
1.14.x it would be best to compare.
* Log of the JobManager as it may be a problem on that side.
Best, Sebastian
> Flink checkpoints are very slow after upgrading from Flink 1.13.1 to Flink
> 1.14.3
> ---------------------------------------------------------------------------------
>
> Key: FLINK-27481
> URL: https://issues.apache.org/jira/browse/FLINK-27481
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.14.3, 1.14.4
> Reporter: Monika Hristova
> Priority: Major
>
> I am experiencing extremely slow checkpoints after upgrading flink version
> from 1.13.1 to 1.14.3. The checkpointing is slow because of the sink/source.
> Example
> [!https://i.stack.imgur.com/oChk9.png!|https://i.stack.imgur.com/oChk9.png]
> This source is a kafka topic that have some messages inside and still, it
> might take up to minutes to be checkpointed.
> I am using incremental checkpoints, unaligned checkpoints are not enabled.
> Configurations are the default ones, and this source was checkpointed for
> milliseconds with flink 1.13.1 and now it times out(the timeout is 3 minutes)
> for every second chechpoint.
> [!https://i.stack.imgur.com/kTbSx.png!|https://i.stack.imgur.com/kTbSx.png]
> [FlinkKafkaConsumer|https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.html]/[Producer|https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer.html]
> are used which are deprecated.
>
> After removing the topic with the few configurational messages the checkpoint
> time improved drastically but it still takes around a minute for the
> checkpoint due to alignment duration in the kafka sinks.
>
> [Link
> |https://stackoverflow.com/questions/70986139/flink-checkpoints-are-very-slow-after-upgrading-from-flink-1-13-1-to-flink-1-14]to
> stackoverflow discusstion
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
