[ 
https://issues.apache.org/jira/browse/FLINK-21086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yun Gao updated FLINK-21086:
----------------------------
    Description: 
For a non-source task, if one of its precedent task has finished, the precedent 
task would send EndOfPartition to it. However, currently the 
CheckpointBarrierHandler could not support receiving EndOfPartitionEvent. To 
support checkpoint after some tasks finish, when received EndOfPartitionEvent 
the CheckpointBarrierHandler should

#  For all the pending checkpoints, mark this channel as aligned.
#  For the future checkpoints, excludes this channel. 

  was:For a non-source task, if one of its precedent task has finished, the 
precedent task would send EndOfPartition to it. Then for checkpoint after that, 
this task would not receive the barrier from the channel that has sent 
EndOfPartition. To finish the alignment, CheckpointBarrierHandler would insert 
barriers before EndOfPartition for these channels.


> Support checkpoint alignment with finished input channels
> ---------------------------------------------------------
>
>                 Key: FLINK-21086
>                 URL: https://issues.apache.org/jira/browse/FLINK-21086
>             Project: Flink
>          Issue Type: Sub-task
>          Components: API / DataStream, Runtime / Checkpointing
>            Reporter: Yun Gao
>            Priority: Major
>              Labels: pull-request-available
>
> For a non-source task, if one of its precedent task has finished, the 
> precedent task would send EndOfPartition to it. However, currently the 
> CheckpointBarrierHandler could not support receiving EndOfPartitionEvent. To 
> support checkpoint after some tasks finish, when received EndOfPartitionEvent 
> the CheckpointBarrierHandler should
> #  For all the pending checkpoints, mark this channel as aligned.
> #  For the future checkpoints, excludes this channel. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to