JingsongLi opened a new pull request, #534: URL: https://github.com/apache/paimon-rust/pull/534
## What changed - Resolve `BlobDescriptor` columns and URI range groups concurrently. - Share a reader-lifetime limiter across metadata and range I/O. - Cap active I/O at 8 requests and range admission at 64 MiB. - Preserve row and column order, with deterministic concurrency tests. ## Why External `BlobDescriptor` materialization awaited descriptor columns, URI groups, and merged ranges serially. On high-latency object storage, those round trips accumulated across a batch. This change adds bounded asynchronous concurrency while retaining the existing per-URI range coalescing. ## Impact This improves latency and throughput for batches containing multiple non-coalescible external descriptors while bounding request pressure and admitted range bytes. The ordinary `.blob` reader and public configuration remain unchanged. ## Validation - `cargo test -p paimon` - `cargo clippy -p paimon --all-targets -- -D warnings` - `cargo fmt --all -- --check` - `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
