TheR1sing3un opened a new pull request, #10429: URL: https://github.com/apache/paimon/pull/10429
### Purpose Add `to_ray()` to vector search and batch vector search queries. Candidate search resolves one snapshot eagerly; final row lookup uses the existing Paimon Ray datasource lazily on workers, avoiding driver materialization of selected columns. Batch queries return one Dataset per input vector. Preserve pre/post filters, deletion vectors, score output, deterministic global score ordering, typed empty results, and snapshot consistency across later updates/deletes. Return BLOB descriptors with the metadata needed by `map_with_blobs`. Document snapshot retention and the independent batch lookup pipelines. ### Tests 7 real-Ray integration tests passed for local/Ray candidate execution, distributed lookup, score ordering, snapshot pinning, filters/empty schema, metadata-only results, batch queries, and resolving BLOBs on workers. Another 25 existing multimodal search/Ray regression tests passed. Flake8 and `git diff --check` passed. No benchmark code included. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
