JingsongLi opened a new pull request, #473: URL: https://github.com/apache/paimon-rust/pull/473
## Summary Adds hybrid search support to paimon-rust by combining vector and full-text search routes with Paimon-compatible rankers. Exposes a Spark-style `hybrid_search` table function in the DataFusion integration. ## Changes - Add core `HybridSearchBuilder` with vector routes, full-text routes, and `rrf`, `weighted_score`, and `mrr` ranking strategies. - Extend vector and full-text builders to return scored search results for hybrid ranking. - Add DataFusion `hybrid_search(...)` table function using Spark-style `array(named_struct(...))` route definitions. - Register the DataFusion function automatically when the `fulltext` feature is enabled. - Add coverage for the Spark-shaped hybrid search SQL path. ## Testing - [x] `cargo fmt --all` - [x] `cargo test -p paimon --features fulltext hybrid_search_builder -- --nocapture` - [x] `cargo test -p paimon-datafusion --features fulltext --test read_tables hybrid_search_tests::test_hybrid_search_vector_route_spark_shape -- --nocapture` - [x] `cargo test -p paimon --features fulltext full_text_search_builder -- --nocapture` - [x] `cargo test -p paimon-datafusion --features fulltext --test read_tables fulltext_tests::test_full_text_search_paimon -- --nocapture` - [x] `cargo test -p paimon-datafusion --test read_tables vector_search_tests::test_vector_search_java_vindex_table -- --nocapture` - [x] `cargo clippy -p paimon --features fulltext --lib -- -D warnings` - [x] `cargo clippy -p paimon-datafusion --features fulltext --lib --tests -- -D warnings` ## Notes The DataFusion table function currently returns the matched table rows. Exposing a Spark-compatible metadata score column can be added separately once scan output metadata columns are supported. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
