XiaoHongbo-Hope opened a new pull request, #9126:
URL: https://github.com/apache/paimon/pull/9126
### Purpose
Use an installed JindoSDK automatically when PyPaimon delegates OSS scan
planning to `pypaimon-rust`.
PyPaimon already prefers Jindo for its normal OSS reads. Native planning
reconstructs a temporary Rust catalog, so it otherwise falls back to OpenDAL
even when Jindo is available.
### Changes
- select `fs.oss.impl=jindo` for the temporary native scan-planning catalog
when `pyjindosdk` is available
- keep OpenDAL when Jindo is unavailable
- respect an explicit non-Jindo OSS implementation
This is scoped to the read-only catalog created by `native_plan()` and does
not change the default backend of the general `pypaimon-rust` catalog or its
write path.
Depends on apache/paimon-rust#696.
### Validation
- `pypaimon/tests/native_plan_test.py`: 30 passed, 6 subtests passed
- flake8 and `git diff --check`
- OSS-backed REST catalog end-to-end read without `fs.oss.impl` or a Jindo
library path:
- native planner selected Jindo
- planned `1 split / 1 file`
- read the expected row
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
