Stefan Richter created FLINK-32345:
--------------------------------------
Summary: Improve parallel download of RocksDB incremental state
Key: FLINK-32345
URL: https://issues.apache.org/jira/browse/FLINK-32345
Project: Flink
Issue Type: Improvement
Components: Runtime / State Backends
Reporter: Stefan Richter
Assignee: Stefan Richter
Fix For: 1.19.0
{{RocksDBStateDownloader}} is used to download the files for incremental
checkpoints in parallel. However, the parallelism is currently restricted to a
single {{IncrementalRemoteKeyedStateHandle}} and also a single state type
(shared, private) within the handle at a time.
We should support parallelization across multiple state types and across
multiple state handles. In particular, this can improve our download times for
scale-in.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
