tzphh opened a new pull request, #10984:
URL: https://github.com/apache/paimon/pull/10984

   ### Purpose
   
   Batch vector queries on primary-key tables can open the same data file 
repeatedly during result lookup. Group matches by partition, bucket, and file, 
read the union of physical positions once, and distribute the rows back to each 
query. Preserve projections, deletion-vector filtering, empty results, and 
per-query limits.
   
   Local and Ray `search_vectors(...).to_arrow()` share this lookup on the 
driver. Queries with post-read filters, query authorization, native reads, or 
unsupported position mappings use individual lookup.
   
   Supersedes #10982. This branch is based on current master, which already 
includes #10828.
   
   ### Tests
   
   - Targeted Python regressions for primary-key batch lookup, Java golden 
files, local and Ray vector queries, and search result handling (199 passed, 3 
skipped).
   - The overlapping-result regression verifies that three nonempty queries 
open one data-file reader and return the same rows as independent lookups.
   - Flake8 with the repository configuration and `git diff --check` passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to