JingsongLi opened a new pull request, #9954:
URL: https://github.com/apache/paimon/pull/9954

   ## What changed
   
   - add the read.native.enabled opt-in table option
   - preserve opaque Rust splits from native planning and send them to the Rust 
reader
   - use Rust-produced PyArrow batches in to_arrow and to_arrow_batch_reader
   - retain exact PyPaimon limit and schema behavior
   - fall back to the Python reader for unsupported controls, transformed 
splits, query-auth splits, or native setup failures
   - document the feature and add unit plus real Rust integration coverage
   
   ## Rust binding
   
   Streaming batches are provided by apache/paimon-rust#870. The adapter 
remains compatible with the existing eager read API until that release is 
available.
   
   ## Tests
   
   - python3 -m pytest -q pypaimon/tests/native_read_test.py 
pypaimon/tests/native_plan_test.py
   - Python/Rust integration: 21 passed, 9 subtests passed in 
native_plan_integration_test.py
   - paimon-rust binding tests: 80 passed
   - paimon-rust core tests: 73 passed


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to