[ 
https://issues.apache.org/jira/browse/FLINK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714946#comment-17714946
 ] 

Piotr Nowojski commented on FLINK-31846:
----------------------------------------

{quote}
f the final checkpoint cannot be cancelled, can we bring it forward to start 
upon completion of all tasks?
{quote}
I'm afraid it's not possible at the moment, but would be a valid feature 
request.

I'm not sure how helpful is this, but you can also manually trigger checkpoints:
https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/ops/rest_api/#jobs-jobid-checkpoints-1

Alternatively, you can also disable checkpoints with finished tasks. If your 
sources are finishing more or less all at once, the only thing you are 
sacrificing is exactly-once semantic (like committing transactions to Kafka). 
But you could still use Kafka sink with at-least-once semantic.

> Support cancel final checkpoint when all tasks are finished
> -----------------------------------------------------------
>
>                 Key: FLINK-31846
>                 URL: https://issues.apache.org/jira/browse/FLINK-31846
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.15.2
>            Reporter: Fan Hong
>            Priority: Major
>
> As stated in [1], all tasks will wait for the final checkpoint before 
> exiting. It also mentioned this mechanism will prolong the execution time.
> So, can we provide configurations to make tasks NOT wait for the final 
> checkpoint?
>  
>  [1]: 
> https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/checkpointing/#waiting-for-the-final-checkpoint-before-task-exit



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to