JingsongLi opened a new pull request, #453: URL: https://github.com/apache/paimon-rust/pull/453
## Summary Upgrade the DataFusion integration to DataFusion 54.0.0 and refresh the generated Rust dependency metadata. This also updates the SQL documentation to reflect the current DataFusion-delegated SQL surface and the Paimon-specific SQL support implemented by `SQLContext`. ## Changes - Bump workspace `datafusion` and `datafusion-ffi` dependencies to 54.0.0. - Adapt DataFusion integration and Python binding code for DataFusion 54 API changes around downcasting and execution plan statistics. - Update `INSERT OVERWRITE ... PARTITION` explicit column handling for the DataFusion 54 SQL AST shape. - Refresh generated `DEPENDENCIES.rust.tsv` files. - Update `docs/src/sql.md` for DataFusion 54 SQL support, Paimon-specific DDL/DML support, positive `LIKE` pushdown, async catalog registration examples, and a broken DataFusion docs anchor. ## Testing - `cargo fmt --all -- --check` - `mkdocs build -f docs/mkdocs.yml --strict` - `cargo test -p paimon-datafusion --test sql_context_tests test_show_tables_is_enabled` - `cargo test -p paimon-datafusion --test delete_tests test_delete_data_evolution_table_with_deletion_vectors` - `cargo test -p paimon-datafusion --test merge_into_tests test_when_matched_delete_with_deletion_vectors` - `cargo test -p paimon-datafusion --test read_tables -- --skip vector_search_tests::test_vector_search_top3 --skip vector_search_tests::test_vector_search_top6_returns_all` - `cargo test -p pypaimon_rust` ## Notes A local full `cargo test -p paimon-datafusion` run passes the rest of the suite but cannot complete two vector search tests without the Lumina native library: - `vector_search_tests::test_vector_search_top3` - `vector_search_tests::test_vector_search_top6_returns_all` Both fail locally with `Failed to load lumina library from 'liblumina_py.dylib'`; `liblumina_py.dylib` was not present on this machine, and `LUMINA_LIB_PATH` is not set. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
