[
https://issues.apache.org/jira/browse/FLINK-35030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17840276#comment-17840276
]
Yanfei Lei edited comment on FLINK-35030 at 4/24/24 3:48 AM:
-------------------------------------------------------------
[~yunfengzhou]
> Thus shall we modify the scope of this ticket, not just for watermark, but
> for all possible events?
Thanks for the suggestion, I'll change the scope of this ticket.
> I suppose checkpoint barriers will also use the strict-order mode of the
> Epoch mechanism. If this is the case, do we still need the checkpoint
> draining introduced in FLINK-35027?
We are considering storing some state requests in AEC into checkpoints(see
[faster checkpoint
drain|https://cwiki.apache.org/confluence/display/FLINK/FLIP-425%3A+Asynchronous+Execution+Model#FLIP425:AsynchronousExecutionModel-FasterCheckpointDrain]
), like unaligned checkpoint. Therefore we handle checkpoint barrier
separately first.
was (Author: yanfei lei):
[~yunfengzhou]
> Thus shall we modify the scope of this ticket, not just for watermark, but
> for all possible events?
Thanks for the suggestion, I'll change the scope of this ticket.
> I suppose checkpoint barriers will also use the strict-order mode of the
> Epoch mechanism. If this is the case, do we still need the checkpoint
> draining introduced in FLINK-35027?
We are considering storing some state requests in AEC into
checkpoints(see[faster checkpoint
drain|[https://cwiki.apache.org/confluence/display/FLINK/FLIP-425%3A+Asynchronous+Execution+Model#FLIP425:AsynchronousExecutionModel-FasterCheckpointDrain]]
), like unaligned checkpoint. Therefore we handle checkpoint barrier
separately first.
> Introduce Epoch Manager for under async execution
> --------------------------------------------------
>
> Key: FLINK-35030
> URL: https://issues.apache.org/jira/browse/FLINK-35030
> Project: Flink
> Issue Type: Sub-task
> Reporter: Yanfei Lei
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)