Stefan Richter created FLINK-32345: -------------------------------------- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink Issue Type: Improvement Components: Runtime / State Backends Reporter: Stefan Richter Assignee: Stefan Richter Fix For: 1.19.0
{{RocksDBStateDownloader}} is used to download the files for incremental checkpoints in parallel. However, the parallelism is currently restricted to a single {{IncrementalRemoteKeyedStateHandle}} and also a single state type (shared, private) within the handle at a time. We should support parallelization across multiple state types and across multiple state handles. In particular, this can improve our download times for scale-in. -- This message was sent by Atlassian Jira (v8.20.10#820010)