[
https://issues.apache.org/jira/browse/FLINK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366623#comment-17366623
]
Piotr Nowojski commented on FLINK-22805:
----------------------------------------
Thanks for stating the problem, but do you have a suggested solution to it?
From the top of my head, I don't see an easy way to reliably solve this
automatically.
Would it be an option to provide some REST API calls to pause/restart
triggering checkpoints on demand? At least as a first step? Users could either
invoke it manually or provide external scripts to manage this?
> Dynamic configuration of Flink checkpoint interval
> --------------------------------------------------
>
> Key: FLINK-22805
> URL: https://issues.apache.org/jira/browse/FLINK-22805
> Project: Flink
> Issue Type: New Feature
> Components: Runtime / Checkpointing
> Affects Versions: 1.13.1
> Reporter: Fu Kai
> Priority: Major
> Labels: auto-deprioritized-critical
> Fix For: 1.14.0
>
>
> Flink currently does not support dynamic configuration of checkpoint interval
> on the fly. It's useful for use cases like backfill/cold-start from a stream
> containing whole history.
>
> In the cold-start phase, resources are fully utilized and the back-pressure
> is high for all upstream operators, causing the checkpoint timeout
> constantly. The real production traffic is far less than that and the
> provisioned resource is capable of handling it.
>
> With the dynamic checkpoint interval configuration, the cold-start process
> can be speeded up with less frequent checkpoint interval or even turned off.
> After the process is completed, the checkpoint interval can be updated to
> normal.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
