XiaoHongbo-Hope opened a new pull request, #10393: URL: https://github.com/apache/paimon/pull/10393
### Purpose Companion to apache/paimon-rust#1028: allow native OSS plan/read to use the C++ backend while Python I/O, including Blob downloads, keeps using Jindo or legacy implementations. ### Changes - Accept `fs.oss.impl=cpp` in Python OSS routing; select its Python backend with `fs.oss.python.impl` (`jindo` by default, or `legacy`). Preserve the original options passed to Rust. - Apply the same selection to PyArrow FileIO and PVFS, including path handling. Keep native-only C++ options out of Jindo configuration. - Document the separately installed bridge, read-only scope, and worker requirements. Native enablement/fallback rules are unchanged. ### Validation Five focused suites (`oss_legacy_mode_test`, `pvfs_oss_filesystem_test`, `jindo_file_system_test`, `native_plan_test`, `native_read_test`): **161 passed, 19 skipped, 46 subtests passed**, Python 3.11 / PyArrow 19.0.1. Tests cover Python backend selection with/without Jindo, invalid options, configuration preservation, and REST native Table reuse. These are isolated routing/reader tests, not a live OSS/C++ performance run. `git diff --check` passes. Whole-file Flake8 reports three existing findings also reproduced on the unmodified base (`pvfs.py` F821; `native_plan_test.py` F821/E305); no new findings. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
