JingsongLi opened a new pull request, #10023:
URL: https://github.com/apache/paimon/pull/10023

   ## What changed
   
   - pass chunk-shuffle seed, live-row chunk size, and worker shard directly to 
the Rust table scan
   - retain each opaque Rust split for native reading while exposing a stable 
Python metadata facade
   - preserve file-local slice diagnostics and exact merged row counts without 
serializing away native-only state
   - remove the old post-native-plan Python chunk transformation
   - fall back to the complete Python planner when the installed binding does 
not expose native chunk planning
   - strengthen chunk-shuffle coverage so Python planning and reading are 
patched to fail during native-mode assertions
   
   ## Coverage
   
   The matrix covers append and data-evolution tables, with and without 
deletion vectors, null and non-null partitions, signed and very large seeds, 
five-worker sharding, projection, partition filters, time travel, empty plans, 
and incremental reads.
   
   ## Dependency
   
   Depends on apache/paimon-rust#890.
   
   ## Verification
   
   - 157 native plan/read tests passed
   - 20 final native chunk-shuffle integration cases passed against the wheel 
built from apache/paimon-rust#890
   - 50 native-plan unit tests and 53 subtests passed
   - flake8 passed with paimon-python/dev/cfg.ini


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to