shyjsarah opened a new pull request, #781: URL: https://github.com/apache/paimon-rust/pull/781
## Summary Fix lateral `vector_search` queries that return string columns. Paimon materializes strings as Arrow `Utf8`, while DataFusion may expose the table-provider schema as `Utf8View`; constructing the lateral result batch without aligning those types caused an Arrow schema mismatch at execution time. ## Changes - Align each materialized target column with the DataFusion provider schema before constructing the lateral result batch. - Resolve target columns by name rather than relying on positional layout. - Extend the existing string-column vector search regression to cover the lateral path and validate returned string values. ## Testing - [x] `cargo test -p paimon-datafusion --test read_tables vector_search_tests::test_vector_search_casts_string_column -- --exact` - [x] `cargo test -p paimon-datafusion --lib lateral_vector_search::tests` - [x] `cargo fmt --all -- --check` - [x] `git diff --check` - [x] `cargo clippy -p paimon-datafusion --lib --tests -- -D warnings` ## Notes This change does not affect the public API or vector-search ranking semantics. It applies the same schema-alignment behavior already used by the non-lateral vector search materialization path. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
