liangjie3138 opened a new pull request, #8834:
URL: https://github.com/apache/paimon/pull/8834
• ### Purpose
Close [#8825](https://github.com/apache/paimon/issues/8825)
This PR adds distributed Vector Search support for Flink.
Key changes:
- Support local and distributed search for Data Evolution and primary-key
tables.
- Search Indexed and Raw data in one Flink job with global TopK merging
and optional refinement.
- Extend sys.vector_search with filters, partition pruning, score
projection, snapshot consistency, and parameter validation.
- Support multi-field vector indexes and reduce Raw prefilter
serialization overhead.
- Update the related Flink documentation.
### Tests
Added unit and integration tests covering:
- Local and distributed search for Data Evolution and primary-key tables.
- Indexed, Raw, and mixed Indexed + Raw search with filtering and global
TopK.
- Multi-field indexes, refinement, partition pruning, score projection,
and snapshot consistency.
- Empty tables, schema evolution, parameter validation, and unsupported
configurations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
