JingsongLi opened a new pull request, #960:
URL: https://github.com/apache/paimon-rust/pull/960

   ## Summary
   
   - Support `data-evolution.nested-field.enabled` for native Parquet table 
reads and partial-column writes. Reconstruct physical ROW schemas from dotted 
`write_cols` paths and apply Java's one-level partial-write validation.
   - Select the latest file per nested leaf when merging row-ID groups, 
preserve parent and child ROW nullness under nested projections and historical 
schemas, and read only the provider children needed for composition.
   - Support nested SET paths in row-ID updates, use leaf IDs for nested row-ID 
conflict checks, and keep projected scan groups when their files contain nested 
write paths.
   
   The behavior follows Java's `RowType.projectByPaths`, 
`DataEvolutionReadPlanner`, `DataEvolutionRow`, and 
`RowIdColumnConflictChecker`. The change adds 2,184 lines, including focused 
unit and Parquet end-to-end regression tests.
   
   ## Verification
   
   - `cargo test -p paimon --lib data_evolution_ --quiet` (144 passed, 1 
ignored)
   - `cargo test -p paimon --lib table::data_file_reader::row_tests --quiet` 
(10 passed)
   - `cargo test -p paimon --lib table::table_commit::tests --quiet` (102 
passed)
   - `cargo test -p paimon --lib table::table_scan::tests --quiet` (107 passed)
   - `cargo fmt --all -- --check`
   - `cargo clippy --locked --all-targets --workspace --features 
fulltext,vortex -- -D warnings`
   - `cargo +1.94.0 check --locked --workspace --all-targets --all-features`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to