tzphh opened a new pull request, #10984: URL: https://github.com/apache/paimon/pull/10984
### Purpose Batch vector queries on primary-key tables can open the same data file repeatedly during result lookup. Group matches by partition, bucket, and file, read the union of physical positions once, and distribute the rows back to each query. Preserve projections, deletion-vector filtering, empty results, and per-query limits. Local and Ray `search_vectors(...).to_arrow()` share this lookup on the driver. Queries with post-read filters, query authorization, native reads, or unsupported position mappings use individual lookup. Supersedes #10982. This branch is based on current master, which already includes #10828. ### Tests - Targeted Python regressions for primary-key batch lookup, Java golden files, local and Ray vector queries, and search result handling (199 passed, 3 skipped). - The overlapping-result regression verifies that three nonempty queries open one data-file reader and return the same rows as independent lookups. - Flake8 with the repository configuration and `git diff --check` passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
