danielcweeks opened a new pull request, #15678: URL: https://github.com/apache/iceberg/pull/15678
The S3FileIO implementation never refreshes the credentials that are held directly from the table load. The s3 clients use a VendedCredentialProvider that internally refreshes the AWS client, but those updates are not reflected back to the FileIO. If an S3FileIO instance is serialized to remote workers, the credentials may be expired triggering a thundering herd of requests to refresh immediately. This change addresses this problem by proactively updating the credentials in the FileIO so that only valid credentials are propagated to remote clients. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
