[
https://issues.apache.org/jira/browse/FLINK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Bhushan Ratnakar updated FLINK-18676:
------------------------------------------
Description:
*Background:*
I am using Flink 1.11.0 on kubernetes platform. To give access of aws services
to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I
have configured below property in flink-conf.yaml to use credential provider.
fs.s3a.aws.credentials.provider:
com.amazonaws.auth.WebIdentityTokenCredentialsProvider
*Issue:*
When taskmanager/jobmanager is starting up, during this it complains that
"WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and
container doesn't come up.
*Solution:*
Currently the above credential's class is being used from
"*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from
"*flink-s3-fs-base*". In *"flink-s3-fs-base",* version of aws
[[fs.s3.aws.version||#L36]]
[https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]
[]|#L36]] is 1.11.754 . The support of default constructor for
"WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and
onward.
was:
*Background:*
I am using Flink 1.11.0 on kubernetes platform. To give access of aws services
to taskmanager/jobmanager, we are using "IAM Roles for Service Accounts" . I
have configured below property in flink-conf.yaml to use credential provider.
fs.s3a.aws.credentials.provider:
com.amazonaws.auth.WebIdentityTokenCredentialsProvider
*Issue:*
When taskmanager/jobmanager is starting up, during this it complains that
"WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and
container doesn't come up.
*Solution:*
Currently the above credential's class is being used from
"*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from
"*flink-s3-fs-base*". In *"flink-s3-fs-base",* version of aws
[fs.s3.aws.version|[https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]]
is 1.11.754 . The support of default constructor for
"WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788 and
onward.
> Update version of aws to support use of default constructor of
> "WebIdentityTokenCredentialsProvider"
> ----------------------------------------------------------------------------------------------------
>
> Key: FLINK-18676
> URL: https://issues.apache.org/jira/browse/FLINK-18676
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem
> Affects Versions: 1.11.0
> Reporter: Ravi Bhushan Ratnakar
> Priority: Minor
>
> *Background:*
> I am using Flink 1.11.0 on kubernetes platform. To give access of aws
> services to taskmanager/jobmanager, we are using "IAM Roles for Service
> Accounts" . I have configured below property in flink-conf.yaml to use
> credential provider.
> fs.s3a.aws.credentials.provider:
> com.amazonaws.auth.WebIdentityTokenCredentialsProvider
>
> *Issue:*
> When taskmanager/jobmanager is starting up, during this it complains that
> "WebIdentityTokenCredentialsProvider" doesn't have "public constructor" and
> container doesn't come up.
>
> *Solution:*
> Currently the above credential's class is being used from
> "*flink-s3-fs-hadoop"* which gets "aws-java-sdk-core" dependency from
> "*flink-s3-fs-base*". In *"flink-s3-fs-base",* version of aws
> [[fs.s3.aws.version||#L36]]
> [https://github.com/apache/flink/blob/release-1.11.0/flink-filesystems/flink-s3-fs-base/pom.xml#L36]
> []|#L36]] is 1.11.754 . The support of default constructor for
> "WebIdentityTokenCredentialsProvider" is provided from aws version 1.11.788
> and onward.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
