XiaoHongbo-Hope opened a new pull request, #7959:
URL: https://github.com/apache/paimon/pull/7959
### Purpose
Daft reads against an Apache Paimon REST catalog fail with OSS 401 once
the initial STS token expires. Daft's native parquet reader binds OSS
credentials into a static `IOConfig` at `PaimonDataSource` construction, and
refreshed STS tokens from pypaimon's
`file_io` cannot be plumbed back into it.
Until Daft exposes a token-refresh callback, route REST catalogs through
pypaimon's reader (`_PaimonPKSplitTask`), which shares the catalog's
token-aware `file_io`.
Also stops `_read_table` trimming `catalog_options` to `{warehouse: ...}`
— `PaimonDataSource` needs the `metastore` field for this decision.
### Tests
`daft_catalog_rest_test.py::DaftRestReadTest::test_read_table_forwards_full_catalog_options_to_datasource`
`daft_catalog_rest_test.py::DaftRestReadTest::test_rest_catalog_disables_native_parquet_reader`
Both fail on master and pass on this branch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
