Ravi Bhushan Ratnakar created FLINK-18676:
---------------------------------------------
Summary: Update version of aws to support use of default
constructor of "WebIdentityTokenCredentialsProvider"
Key: FLINK-18676
URL: https://issues.apache.org/jira/browse/FLINK-18676
Project: Flink
Issue Type: Improvement
Components: Connectors / FileSystem
Affects Versions: 1.11.0
Reporter: Ravi Bhushan Ratnakar
*Background:*
I am using Flink 1.11.0 on kubernetes platform. To give access of aws services
to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I
have configured below property in flink-conf.yaml to use credential provider.
fs.s3a.aws.credentials.provider:
com.amazonaws.auth.WebIdentityTokenCredentialsProvider
*Issue:*
When taskmanager/jobmanager is starting up, during this it complains that
"WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and
container doesn't come up.
*Solution:*
Currently the above credential's class is being used from
"*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from
"*flink-s3-fs-base*". In *"flink-s3-fs-base",* version of aws
[fs.s3.aws.version|[https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]]
is 1.11.754 . The support of default constructor for
"WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and
onward.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
