XiaoHongbo-Hope opened a new pull request, #629:
URL: https://github.com/apache/paimon-rust/pull/629

   ### Purpose
   
   Row-range pruning for data-evolution tables currently retains an entire 
connected file component. A wide anchor file can therefore keep many disjoint 
rolled BLOB or vector sidecars, causing oversized splits and unnecessary 
planning and read work.
   
   ### Changes
   
   - Keep dedicated files that intersect the selected row ranges.
   - Preserve one provider witness only when no selected file can validate that 
provider, so uncovered-range errors remain detectable.
   - Apply ADD/DELETE netting before witness selection.
   - Read only the selected rolled BLOB/vector sidecars.
   
   ### Tests
   
   - `cargo test -p paimon table::table_scan::tests`
   - `cargo test -p paimon table::data_evolution_reader::tests`
   - `cargo test -p paimon --lib`
   - `cargo clippy --locked -p paimon --lib --tests --no-deps -- -D warnings`
   - `cargo fmt --all -- --check`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to