JingsongLi opened a new pull request, #1446:
URL: https://github.com/apache/paimon-rust/pull/1446

   ### Purpose
   
   Allow Rust and DataFusion clients to read, append to, and create Paimon 
tables containing the Java `GEOMETRY` and `GEOGRAPHY` types. The coordinate 
reference system (CRS) and geography edge algorithm affect how readers 
interpret the same WKB bytes. The Java implementation is 
[apache/paimon#9251](https://github.com/apache/paimon/pull/9251).
   
   ### Brief change log
   
   - Add the Java schema syntax, default CRS, and five geography edge 
algorithms. Preserve these attributes in Arrow `geoarrow.wkb` fields and native 
Parquet logical types, including nested columns.
   - Validate typed assignments and schema changes before writing. Native 
upsert and DataFusion mutation predicates check CRS compatibility before 
matching rows by WKB.
   - Preserve geo types in DataFusion DDL, casts, views, and temporary tables. 
Support insertion of WKB arrays with null elements and null arrays.
   
   ### Tests
   
   - Ran the Rust core library suite (4,946 passed, 7 ignored), the DataFusion 
suite (1,394 passed), and 71 golden warehouse integration tests. Reran 607 
affected DataFusion tests after the final DML predicate changes.
   - Verified Java → Rust → Java Parquet interoperability. Java wrote a 
geometry, a geography with Karney edges, and a nested geometry array containing 
a null. Rust read and appended those values. Java verified the bytes and nulls 
in both rows.
   - Ran workspace checks, strict Clippy for the core and DataFusion crates, 
and formatting checks.
   
   ### API and Format
   
   The Rust schema API exposes `GeometryType`, `GeographyType`, and 
`EdgeAlgorithm`. Geo columns carry WKB in Arrow binary storage and use native 
Parquet geospatial annotations. The Rust Row format also supports these types. 
Cross-language exchange uses Parquet because the tested Java Row codec does not 
handle geo columns.
   
   ### Documentation
   
   Updated the [SQL type 
reference](https://github.com/JingsongLi/paimon-rust/blob/c4acf6ee0c1927aea4b04f650670ace69b79d356/docs/src/sql.md#data-types)
 with the DDL syntax, WKB array insertion, and the scope of spatial function 
support.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to