[
https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835975#comment-17835975
]
Zakelly Lan commented on FLINK-34704:
-------------------------------------
[~pnowojski] IIUC, the {{AsyncWaitOperator}} is a special one in following ways:
# It is a non-keyed operator, mainly for async IO fetching data from external
storage/database.
(https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/dev/datastream/operators/asyncio)
# Any on-going (invoked but not complete) requests will stay in a buffer and
can be serialized into checkpoint, once a request finishes it will emit result
to downstream and will not be included in a checkpoint.
So it is designed to be safe to checkpoint during waiting async results (during
yield). This operator is the only one that allow for checkpoint in middle of
waiting. I suggest that we could consider FLINK-35051 first and see if this
ticket is still valid later.
> Process checkpoint barrier in AsyncWaitOperator when the element queue is full
> ------------------------------------------------------------------------------
>
> Key: FLINK-34704
> URL: https://issues.apache.org/jira/browse/FLINK-34704
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Task
> Reporter: Zakelly Lan
> Priority: Minor
>
> As discussed in
> https://lists.apache.org/thread/4f7ywn29kdv4302j2rq3fkxc6pc8myr2 . Maybe it
> is better to provide such a new `yield` that can process mail with low
> priority in the mailbox executor. More discussion needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
