JingsongLi opened a new pull request, #1431: URL: https://github.com/apache/paimon-rust/pull/1431
### Purpose Allow `SQLContext` users to declare Paimon vectors with `VECTOR<element, length>` instead of constructing table schemas through the Rust API. `SHOW CREATE TABLE` can recreate existing vector schemas, including nested non-null vectors. Linked issue: N/A ### Brief change log - Parse and plan vector types using Paimon's existing element, dimension and nullability validation, mapping them to Arrow `FixedSizeList`. - Support vectors in DDL, casts, nested arrays/maps/structs, persistent SQL functions and views. Preserve nested `NOT NULL` and reject fixed-size SQL arrays inside vector MAP cast targets rather than discarding their dimensions. - Preserve ordinary `vector` column expressions and avoid unnecessary parsing for queries without vector type syntax. - Simplify the existing vector-search and MERGE boolean conditions to resolve six Clippy warnings without changing their behavior. ### Tests - `RUST_MIN_STACK=16777216 cargo test --locked -p paimon-datafusion --all-targets` — 1,243 tests passed. - 67 targeted core tests across `de_vector_read`, `pk_vector_search_params`, `vector_search_common` and `table_merge_into`. - `cargo clippy --locked -p paimon-datafusion --all-targets -- -D warnings` - `cargo fmt --all -- --check` Regression cases cover dimension/type validation, SQL read/write and casts, nested nullability and DDL round trips, composite function parameters, function dependency detection, malformed composite types and fixed-size array boundaries. ### API and Format Adds SQL syntax backed by the existing Paimon `VectorType` and Arrow representation. Persisted schema and storage formats do not change. ### Documentation Updated `docs/src/sql.md` with vector syntax, element and dimension limits, nested nullability and the MAP cast limitation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
