JingsongLi opened a new pull request, #889: URL: https://github.com/apache/paimon-rust/pull/889
### Purpose Let PyPaimon pass splits produced by its Python planner to the Rust reader through the stable Java-compatible `SplitSerializer` v1 wire format. This keeps native physical reads available when planning cannot run in Rust, including Data Evolution row-range reads. ### Brief change log - add `pypaimon_rust.datafusion.Split.deserialize(bytes)` for `SplitSerializer` v1 frames - keep the stable wire API separate from the opaque JSON state used by pickle - support DataSplit v8/v9 and score-free IndexedSplit row ranges through the existing Rust decoder - expose the new entry point in the Python type stub - verify ordinary and Data Evolution reads after a serialize/deserialize round trip - reject malformed wire frames with Python `ValueError` ### Tests - `cargo test -p pypaimon_rust` (76 passed) - `cargo clippy -p paimon -p pypaimon_rust --all-targets -- -D warnings` - `cargo fmt --all -- --check` - built and installed the wheel, then ran `bindings/python/tests/test_read.py` (86 passed) - paired PyPaimon native integration suite (35 passed) ### API and Format Adds a Python binding API. It does not change a storage format; the input is the existing `SplitSerializer` v1 format. ### Documentation The type stub documents the distinction between stable split bytes and pickle state. No user guide changes are required. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
