David-Banquet opened a new pull request, #4349: URL: https://github.com/apache/iceberg-python/pull/4349
Related to #2657 # Rationale for this change A `botocore_session` passed to `load_catalog` is used by the Glue and DynamoDB boto3 clients and by the REST catalog's SigV4 signer, but neither `PyArrowFileIO` nor `FsspecFileIO` reads it. With a session built from a profile and different credentials in the environment, catalog calls succeed and the first data write fails with the environment's credentials, as reproduced in #2657. The docs don't mention `botocore_session` at all, so this adds a note under "Unified AWS Credentials". Having the FileIO take the session's credentials would need a code change, and pyarrow's `S3FileSystem` only accepts static keys, so they would expire for SSO or assumed-role sessions. That question is still open in the issue; this PR only documents the current behavior. ## Are these changes tested? Docs only. ## Are there any user-facing changes? Docs only. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
