JingsongLi opened a new pull request, #1446: URL: https://github.com/apache/paimon-rust/pull/1446
### Purpose Allow Rust and DataFusion clients to read, append to, and create Paimon tables containing the Java `GEOMETRY` and `GEOGRAPHY` types. The coordinate reference system (CRS) and geography edge algorithm affect how readers interpret the same WKB bytes. The Java implementation is [apache/paimon#9251](https://github.com/apache/paimon/pull/9251). ### Brief change log - Add the Java schema syntax, default CRS, and five geography edge algorithms. Preserve these attributes in Arrow `geoarrow.wkb` fields and native Parquet logical types, including nested columns. - Validate typed assignments and schema changes before writing. Native upsert and DataFusion mutation predicates check CRS compatibility before matching rows by WKB. - Preserve geo types in DataFusion DDL, casts, views, and temporary tables. Support insertion of WKB arrays with null elements and null arrays. ### Tests - Ran the Rust core library suite (4,946 passed, 7 ignored), the DataFusion suite (1,394 passed), and 71 golden warehouse integration tests. Reran 607 affected DataFusion tests after the final DML predicate changes. - Verified Java → Rust → Java Parquet interoperability. Java wrote a geometry, a geography with Karney edges, and a nested geometry array containing a null. Rust read and appended those values. Java verified the bytes and nulls in both rows. - Ran workspace checks, strict Clippy for the core and DataFusion crates, and formatting checks. ### API and Format The Rust schema API exposes `GeometryType`, `GeographyType`, and `EdgeAlgorithm`. Geo columns carry WKB in Arrow binary storage and use native Parquet geospatial annotations. The Rust Row format also supports these types. Cross-language exchange uses Parquet because the tested Java Row codec does not handle geo columns. ### Documentation Updated the [SQL type reference](https://github.com/JingsongLi/paimon-rust/blob/c4acf6ee0c1927aea4b04f650670ace69b79d356/docs/src/sql.md#data-types) with the DDL syntax, WKB array insertion, and the scope of spatial function support. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
