JingsongLi opened a new pull request, #887:
URL: https://github.com/apache/paimon-rust/pull/887

   ## Purpose
   
   Expand the Python native reader beyond top-level snapshot reads so PyPaimon 
can use Rust for nested projections and changelog-aware reads.
   
   ## Changes
   
   - add nested ROW projection and literal MAP-key projection to the Python 
binding
   - expose row-kind-aware reads for snapshot and streaming splits
   - preserve physical +I/-U/+U/-D events for streaming primary-key splits
   - prune shared-shredding Parquet MAP reads to the physical columns that may 
contain selected keys
   - assemble selected-key MAP results from partial physical structs, including 
missing keys and overflow
   - keep complete MAP reads when field/default aggregation requires full merge 
input
   
   The MAP I/O regression test compares selected-key and full MAP reads over 
100,000 rows and requires selected-key reads to use at least 20% fewer data 
bytes.
   
   ## Tests
   
   - cargo test -p pypaimon_rust nested_projection_
   - cargo test -p paimon test_parquet_map_shredding_selected_key
   - cargo test -p paimon --test audit_log_table_test
   - cargo clippy -p paimon -p pypaimon_rust --all-targets -- -D warnings
   
   This is the Rust prerequisite for the paired apache/paimon Python PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to