[
https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stefan Richter closed FLINK-32345.
----------------------------------
Resolution: Fixed
> Improve parallel download of RocksDB incremental state
> ------------------------------------------------------
>
> Key: FLINK-32345
> URL: https://issues.apache.org/jira/browse/FLINK-32345
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / State Backends
> Reporter: Stefan Richter
> Assignee: Stefan Richter
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.18.0
>
>
> {{RocksDBStateDownloader}} is used to download the files for incremental
> checkpoints in parallel. However, the parallelism is currently restricted to
> a single {{IncrementalRemoteKeyedStateHandle}} and also a single state type
> (shared, private) within the handle at a time.
> We should support parallelization across multiple state types and across
> multiple state handles. In particular, this can improve our download times
> for scale-in.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
