CandiceSu commented on issue #3106:
URL: https://github.com/apache/parquet-java/issues/3106#issuecomment-2563932468
thx @wgtmac
we find out the issue
it's not the avro parquet writer itself caching the token, its the conf
object keep using same token after initialized the 1st time.
Configuration should set "fs.s3a.aws.credentials.provider", otherwise it
uses default TemporaryAWSCredentialsProvider which extends
AbstractSessionCredentialsProvider which keeps using the same credentials once
initialized the 1st time:
`
private final AtomicBoolean initialized = new AtomicBoolean(false);
`
set provider fixed the issue:
`
conf.set("fs.s3a.aws.credentials.provider","software.amazon.awssdk.auth.credentials.ContainerCredentialsProvider");
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
