JingsongLi opened a new pull request, #950: URL: https://github.com/apache/paimon-rust/pull/950
## Summary Extend native Format Table read and write behavior to match the Java implementation: - Read catalog-managed partitions at their registered custom locations. Canonicalize filesystem identities and reject traversal, table-directory overlap, and overlapping partition ownership before listing files. - Write Avro object container files with Java-compatible nullable, logical, and nested schemas. Stream completed Avro blocks to storage, honor `avro.codec` and `file.block-size`, and expose Avro through the existing format writer factory. - Apply schema column defaults after input nullability validation and before partition routing or file projection, matching Java's `DefaultValueRow` order. - Treat a resolved catalog partition root as a complete partition regardless of its filesystem path depth, so hidden staging directories are excluded. ## Verification - `cargo test -p paimon --lib format_ --quiet` (94 passed) - `cargo test -p paimon-datafusion --test rest_format_table_scan --quiet` (12 passed) - `cargo test -p paimon-datafusion --test rest_format_table_dml --quiet` (9 passed) - `cargo test -p paimon --lib file_block_size --quiet` (1 passed) - `cargo clippy -p paimon --lib -- -D warnings` - `cargo fmt --all -- --check` - `git diff --check` The commit adds 2,054 lines, including behavioral tests for Avro round trips, default values, and catalog location failure paths. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
