[
https://issues.apache.org/jira/browse/FLINK-21086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yun Gao updated FLINK-21086:
----------------------------
Description:
For a non-source task, if one of its precedent task has finished, the precedent
task would send EndOfPartition to it. However, currently the
CheckpointBarrierHandler could not support receiving EndOfPartitionEvent. To
support checkpoint after some tasks finish, when received EndOfPartitionEvent
the CheckpointBarrierHandler should
# For all the pending checkpoints, mark this channel as aligned.
# For the future checkpoints, excludes this channel.
was:For a non-source task, if one of its precedent task has finished, the
precedent task would send EndOfPartition to it. Then for checkpoint after that,
this task would not receive the barrier from the channel that has sent
EndOfPartition. To finish the alignment, CheckpointBarrierHandler would insert
barriers before EndOfPartition for these channels.
> Support checkpoint alignment with finished input channels
> ---------------------------------------------------------
>
> Key: FLINK-21086
> URL: https://issues.apache.org/jira/browse/FLINK-21086
> Project: Flink
> Issue Type: Sub-task
> Components: API / DataStream, Runtime / Checkpointing
> Reporter: Yun Gao
> Priority: Major
> Labels: pull-request-available
>
> For a non-source task, if one of its precedent task has finished, the
> precedent task would send EndOfPartition to it. However, currently the
> CheckpointBarrierHandler could not support receiving EndOfPartitionEvent. To
> support checkpoint after some tasks finish, when received EndOfPartitionEvent
> the CheckpointBarrierHandler should
> # For all the pending checkpoints, mark this channel as aligned.
> # For the future checkpoints, excludes this channel.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)