JingsongLi opened a new pull request, #883: URL: https://github.com/apache/paimon-rust/pull/883
### Purpose Prevent sparse BlobDescriptor selections from causing disproportionate I/O and retained buffers after the inline BLOB coalescing work. ### Changes - cap merged descriptor ranges at 2x selected-byte amplification in addition to the existing gap and span limits - copy selected values out of merged reads that contain gaps, so small byte slices do not retain the full backing response - preserve zero-copy slices for fully selected contiguous ranges - add regression coverage for sparse selections and backing-buffer release For 128 selected 4 KiB values separated by 64 KiB gaps, the previous policy merged them into two reads totaling 8.375 MiB for 512 KiB selected data. The new amplification bound keeps this layout as 128 exact reads totaling 512 KiB. ### Tests - cargo test --locked -p paimon table::blob_resolver::tests:: - cargo clippy --locked --all-targets --workspace --features fulltext,vortex -- -D warnings - cargo test --locked -p paimon --all-targets --features fulltext,vortex -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
