[ 
https://issues.apache.org/jira/browse/FLINK-34974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated FLINK-34974:
-----------------------------------
    Labels: pull-request-available  (was: )

> FLIP-424: Asynchronous State APIs
> ---------------------------------
>
>                 Key: FLINK-34974
>                 URL: https://issues.apache.org/jira/browse/FLINK-34974
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / State Backends
>            Reporter: Zakelly Lan
>            Assignee: Zakelly Lan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.0.0
>
>
> This is a sub-FLIP for the disaggregated state management and its related 
> work, please read the [FLIP-423|https://cwiki.apache.org/confluence/x/R4p3EQ] 
> first to know the whole story.
> To maximize I/O capacity utilization and enhance the use of pre-allocated 
> computational resources, this FLIP proposes the introduction of asynchronous 
> state APIs. These APIs permit state access to be executed in threads separate 
> from the task thread, returning the result when available. Consequently, the 
> task thread can process another element while awaiting multiple pending state 
> results. This enables concurrent processing of multiple records, ensuring 
> that the latency of individual I/O operations no longer has a direct impact 
> on job performance. This approach is particularly advantageous in scenarios 
> where I/O bandwidth is underutilized and I/O latency is the limiting factor. 
> The Disaggregated Storage Architecture, as discussed in FLIP-423, is a prime 
> example of a scenario characterized by abundant and easily scalable I/O 
> bandwidth coupled with higher I/O latency. The asynchronous state APIs hold 
> great promise for significantly enhancing Flink's performance when dealing 
> with disaggregated state.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to