JingsongLi opened a new pull request, #399: URL: https://github.com/apache/paimon-rust/pull/399
## Summary Add read-side support for Java `paimon-vector` vindex files through `paimon-vindex-core` 0.1.0. The vector search path now treats vindex as a peer backend to Lumina instead of routing it through the Lumina module. ## Changes - Add a top-level `vindex` module with `ivf-flat`, `ivf-pq`, `ivf-hnsw-flat`, and `ivf-hnsw-sq` index type detection plus a `paimon-vindex-core` backed global index reader. - Move shared vector search request/result IO types into a neutral `vector_search` module so Lumina and vindex readers can share them without coupling vindex to Lumina. - Update `VectorSearchBuilder` to dispatch matching global index files to either the Lumina reader or the vindex reader based on the index type. - Add a DataFusion fixture produced by Java vindex and verify Rust vector search can read and search it. ## Testing - [x] `cargo fmt` - [x] `cargo check -p paimon` - [x] `cargo test -p paimon vector_search --lib` - [x] `cargo test -p paimon vindex --lib` - [x] `cargo test -p paimon lumina --lib` - [x] `cargo test -p paimon-datafusion --test read_tables vector_search_tests::test_vector_search_java_vindex_table` - [x] `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
