jackye1995 commented on PR #4280: URL: https://github.com/apache/iceberg/pull/4280#issuecomment-1483471763
We added one feature for https://github.com/apache/iceberg/blob/master/aws/src/main/java/org/apache/iceberg/aws/AwsProperties.java#L652, which should to some extent mitigate the issue. When it pre-fetches a S3 client, it already serves as a cache for the LF-vended credentials. The issue with this is that when the FileIO is sent across nodes, the credential might be lost. The full solution to distribute the credential for reuse across nodes is not developed yet. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
