naivedogger opened a new pull request, #1452:
URL: https://github.com/apache/paimon-rust/pull/1452

   ### Purpose
   
   Closes #1450.
   
   A worker assigned a physical Paimon bucket currently has to plan a broader 
scan and discard splits for other buckets. A worker shard does not identify a 
physical bucket: its contents depend on the table and scan mode.
   
   ### Brief change log
   
   Add `TableScan::with_bucket(id)`. Snapshot scans prune manifests by bucket 
bounds and filter entries in the remaining manifests. Incremental scans apply 
the selection after validating entries, so it cannot hide an unsupported delete.
   
   ### Tests
   
   The scan test selects bucket 2 from manifests covering [0, 1] and [2, 3]. It 
checks the returned file and verifies that only the second manifest's entries 
were read. The shard test covers both orders of the conflicting builder calls.
   
   ### API and Format
   
   The new method applies to Paimon tables. Combining it with `with_shard` 
returns an error because a shard describes work distribution and need not 
correspond to one physical bucket. Existing scans and the storage format are 
unchanged.
   
   ### Documentation
   
   The scan API documents the scope of bucket selection and its interaction 
with sharding.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to