[
https://issues.apache.org/jira/browse/BEAM-12845?focusedWorklogId=647170&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-647170
]
ASF GitHub Bot logged work on BEAM-12845:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Sep/21 02:41
Start Date: 07/Sep/21 02:41
Worklog Time Spent: 10m
Work Description: meowcakes commented on a change in pull request #15461:
URL: https://github.com/apache/beam/pull/15461#discussion_r703137747
##########
File path: sdks/java/io/amazon-web-services2/build.gradle
##########
@@ -39,6 +39,7 @@ dependencies {
compile library.java.aws_java_sdk2_sdk_core
compile library.java.aws_java_sdk2_sns
compile library.java.aws_java_sdk2_sqs
+ compile library.java.aws_java_sdk2_sts
Review comment:
Any deployment that needs to authenticate by assuming a role using the
`AWS_ROLE_ARN` and `AWS_WEB_IDENTITY_TOKEN_FILE` environment variables would
need the dependency, although to my knowledge EKS with IAM roles for service
accounts is the main use case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 647170)
Remaining Estimate: 0h
Time Spent: 10m
> Spark JobServer should bundle AWS IO libraries to support staging on S3
> -----------------------------------------------------------------------
>
> Key: BEAM-12845
> URL: https://issues.apache.org/jira/browse/BEAM-12845
> Project: Beam
> Issue Type: Improvement
> Components: jobserver
> Affects Versions: 2.32.0
> Reporter: Rogan Morrow
> Priority: P2
> Fix For: 2.33.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The AWS filesystem libraries are not included in the Spark JobServer. These
> are necessary to allow staging artifacts to S3.
> There is a TODO in the code to update the dependencies to support the AWS
> filesystem.
> [https://github.com/apache/beam/blob/master/runners/spark/job-server/spark_job_server.gradle#L62]
> Additionally, the `amazon-web-services2` library is built without a
> dependency on STS. A dependency on STS is needed to support authentication
> from EKS with IAM roles for service accounts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
