JingsongLi opened a new pull request, #10641: URL: https://github.com/apache/paimon/pull/10641
### Purpose Use Rust planning and reading for additional existing PyPaimon REST read views. Depends on https://github.com/apache/paimon-rust/pull/1157; keeping this PR in draft until that core support is available on Rust main. Native CI continues to build Rust main. - Preserve historical/branch schemas and already captured snapshots when constructing the authorized native read view. - Carry the existing resolved FUSE mapping into Rust before schema/snapshot IO, and avoid requesting cloud credentials for mounted data. - Let Python-planned and serialized QueryAuthSplit metadata reach Rust's fresh REST authorization and provenance validation instead of requiring the original opaque native split. - Delegate `plan_for_write` to the core writer scan when supported. Keep custom authorization on Python and cover complete data-evolution file restoration with projected callable updates. - Remove a redundant first-row fallback for ordered L0/materialized merge inputs. All implementations still require PK-sorted inputs for their PK merge reader. - Remove capability checks for unused CatalogContext marker fields and update Native documentation. This does not add arbitrary catalog/FileIO plugin support. Custom providers without a native equivalent and incompatible captured authorization policies retain Python execution. Alias/flatten output formatting already delegates the underlying field projection through `read_type`. ### Tests - With `PYPAIMON_TEST_NATIVE_PLAN=1 PYPAIMON_TEST_NATIVE_READ=1`, the focused `native_read_test.py`, `native_plan_test.py`, `native_plan_materialized_pk_test.py` and `native_read_path_completion_test.py` suite: **159 passed, 16 skipped, 58 subtests passed**. Both real native planning and reading were exercised. - Changed Python files pass Flake8 with `paimon-python/dev/cfg.ini`. - The installed native extension was not rebuilt or installed during local testing. **16 new end-to-end cases require the companion Rust bindings and were skipped locally**; Native CI will exercise them after the Rust PR merges. The new pure-Python callable-update baseline and wrapper dispatch/order/cache regressions ran locally. - Companion core validation: **4222 unit tests and 153 REST integration tests passed**, plus core/binding Clippy on Rust 1.98.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
