[
https://issues.apache.org/jira/browse/FLINK-21084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yun Gao reopened FLINK-21084:
-----------------------------
Since we would holding the upstream tasks till the downstream tasks has
finished processing the remaining record, during this period, we would have to
include the upstream tasks in the checkpoint process. In another side, since we
have to hold the upstream tasks after all the operators are closed (otherwise
the non-head operator would not have endOfInput() called and might has more
records), we would have to ensure the checkpoint is supported even some
operators are closed.
> Allows tasks to report operator subtask finish state
> ----------------------------------------------------
>
> Key: FLINK-21084
> URL: https://issues.apache.org/jira/browse/FLINK-21084
> Project: Flink
> Issue Type: Sub-task
> Components: API / DataStream, Runtime / Checkpointing
> Reporter: Yun Gao
> Priority: Major
> Fix For: 1.13.0
>
>
> Once an operator is fully finished (e.g., all its subtasks are finished) in
> one checkpoint, the state need to be recorded to skip the execution of this
> operator after recovery. Thus we should allow operators to report finished
> state so that CheckpointCoordinator could identify fully finished operators
> for each checkpoint.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
