[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385353=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385353
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 18:32
Start Date: 11/Feb/20 18:32
Worklog Time Spent: 10m 
  Work Description: ecapoccia commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#discussion_r377819364
 
 

 ##
 File path: 
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/options/AwsModule.java
 ##
 @@ -122,6 +123,8 @@ public AWSCredentialsProvider deserializeWithType(
 return new SystemPropertiesCredentialsProvider();
   } else if 
(typeName.equals(ProfileCredentialsProvider.class.getSimpleName())) {
 return new ProfileCredentialsProvider();
+  } else if 
(typeName.equals(WebIdentityTokenCredentialsProvider.class.getSimpleName())) {
+return WebIdentityTokenCredentialsProvider.create();
 
 Review comment:
   yup will do @iemejia 
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385353)
Time Spent: 2h  (was: 1h 50m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
> Fix For: 2.20.0
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385310=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385310
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 17:51
Start Date: 11/Feb/20 17:51
Worklog Time Spent: 10m 
  Work Description: iemejia commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#discussion_r377797561
 
 

 ##
 File path: 
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/options/AwsModule.java
 ##
 @@ -122,6 +123,8 @@ public AWSCredentialsProvider deserializeWithType(
 return new SystemPropertiesCredentialsProvider();
   } else if 
(typeName.equals(ProfileCredentialsProvider.class.getSimpleName())) {
 return new ProfileCredentialsProvider();
+  } else if 
(typeName.equals(WebIdentityTokenCredentialsProvider.class.getSimpleName())) {
+return WebIdentityTokenCredentialsProvider.create();
 
 Review comment:
   Nice info, @andeb would you be up to do the minor cleanup?
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385310)
Time Spent: 1h 40m  (was: 1.5h)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
> Fix For: 2.20.0
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385312
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 17:51
Start Date: 11/Feb/20 17:51
Worklog Time Spent: 10m 
  Work Description: iemejia commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#discussion_r377797561
 
 

 ##
 File path: 
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/options/AwsModule.java
 ##
 @@ -122,6 +123,8 @@ public AWSCredentialsProvider deserializeWithType(
 return new SystemPropertiesCredentialsProvider();
   } else if 
(typeName.equals(ProfileCredentialsProvider.class.getSimpleName())) {
 return new ProfileCredentialsProvider();
+  } else if 
(typeName.equals(WebIdentityTokenCredentialsProvider.class.getSimpleName())) {
+return WebIdentityTokenCredentialsProvider.create();
 
 Review comment:
   Thanks for the info @ecapoccia, @andeb would you be up to do the minor 
cleanup?
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385312)
Time Spent: 1h 50m  (was: 1h 40m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
> Fix For: 2.20.0
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385250=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385250
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 16:03
Start Date: 11/Feb/20 16:03
Worklog Time Spent: 10m 
  Work Description: ecapoccia commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#discussion_r377731971
 
 

 ##
 File path: 
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/options/AwsModule.java
 ##
 @@ -122,6 +123,8 @@ public AWSCredentialsProvider deserializeWithType(
 return new SystemPropertiesCredentialsProvider();
   } else if 
(typeName.equals(ProfileCredentialsProvider.class.getSimpleName())) {
 return new ProfileCredentialsProvider();
+  } else if 
(typeName.equals(WebIdentityTokenCredentialsProvider.class.getSimpleName())) {
+return WebIdentityTokenCredentialsProvider.create();
 
 Review comment:
   Hi, interestingly I wrote a similar code to this to upgrade AWS client and 
support Pod Identity.
   
   However I did not have to add another "else if" case; I exploited the 
existing DefaultAWSCredentialsProviderChain which you can call by specifying 
"--awsCredentialsProvider={\"@type\": \"DefaultAWSCredentialsProviderChain\"}".
   
   The default provider chain already incorporates the 
WebIdentityTokenCredentialsProvider.
   
   See 
https://github.com/aws/aws-sdk-java/blob/master/aws-java-sdk-core/src/main/java/com/amazonaws/auth/DefaultAWSCredentialsProviderChain.java#L48
 here for the relevant line in the AWS client.
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385250)
Time Spent: 1.5h  (was: 1h 20m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
> Fix For: 2.20.0
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385079=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385079
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 10:55
Start Date: 11/Feb/20 10:55
Worklog Time Spent: 10m 
  Work Description: iemejia commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385079)
Time Spent: 1h 20m  (was: 1h 10m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
> Fix For: 2.20.0
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385078=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385078
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 10:54
Start Date: 11/Feb/20 10:54
Worklog Time Spent: 10m 
  Work Description: iemejia commented on issue #10825: [BEAM-9160] Update 
AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584578754
 
 
   Merged manually to remove some extra chars in the commit title.
   Thanks again @andeb !
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385078)
Time Spent: 1h 10m  (was: 1h)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-11 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=385075=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385075
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 11/Feb/20 10:45
Start Date: 11/Feb/20 10:45
Worklog Time Spent: 10m 
  Work Description: iemejia commented on issue #10825: [BEAM-9160] Update 
AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584575187
 
 
   I did a run of @suztomo's awesome script and it seems amazon-web-services2 
is introducing a lot of unrelated graalvm crap YAY !
   https://gist.github.com/iemejia/a9aa0c1d8f4a0ec22867c3df5471e1d3
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385075)
Time Spent: 1h  (was: 50m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=384844=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-384844
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 10/Feb/20 23:43
Start Date: 10/Feb/20 23:43
Worklog Time Spent: 10m 
  Work Description: lukecwik commented on issue #10825: [BEAM-9160] Update 
AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584413619
 
 
   The code changes look fine otherwise.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 384844)
Time Spent: 50m  (was: 40m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=384843=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-384843
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 10/Feb/20 23:43
Start Date: 10/Feb/20 23:43
Worklog Time Spent: 10m 
  Work Description: lukecwik commented on issue #10825: [BEAM-9160] Update 
AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584413587
 
 
   Can we run the linkage checker to perform analysis on whether we increased 
the number of linkage errors?
   
   Example PR of running the linkage checker:
   https://github.com/apache/beam/pull/10769
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 384843)
Time Spent: 40m  (was: 0.5h)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=384835=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-384835
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 10/Feb/20 23:30
Start Date: 10/Feb/20 23:30
Worklog Time Spent: 10m 
  Work Description: andeb commented on issue #10825: [BEAM-9160] Update AWS 
SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584409822
 
 
   R: @jbonofre @lukecwik @chamikaramj @timrobertson100
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 384835)
Time Spent: 0.5h  (was: 20m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=384832=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-384832
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 10/Feb/20 23:26
Start Date: 10/Feb/20 23:26
Worklog Time Spent: 10m 
  Work Description: andeb commented on issue #10825: [BEAM-9160] Update AWS 
SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825#issuecomment-584408814
 
 
   R: @aaltay @kennknowles
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 384832)
Time Spent: 20m  (was: 10m)

> Update AWS SDK to support Pod Level Identity
> 
>
> Key: BEAM-9160
> URL: https://issues.apache.org/jira/browse/BEAM-9160
> Project: Beam
>  Issue Type: Improvement
>  Components: dependencies
>Affects Versions: 2.17.0
>Reporter: Mohamed Noah
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Many organizations have started leveraging pod level identity in Kubernetes. 
> The current version of the AWS SDK packaged with Bean 2.17.0 is out of date 
> and doesn't provide native support to pod level identity access management.
>  
> It is recommended that we introduce support to access AWS resources such as 
> S3 using pod level identity. 
> Current Version of the AWS Java SDK in Beam:
> def aws_java_sdk_version = "1.11.519"
> Proposed AWS Java SDK Version:
> 
>  com.amazonaws
>  aws-java-sdk
>  1.11.710
> 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (BEAM-9160) Update AWS SDK to support Pod Level Identity

2020-02-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-9160?focusedWorklogId=384831=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-384831
 ]

ASF GitHub Bot logged work on BEAM-9160:


Author: ASF GitHub Bot
Created on: 10/Feb/20 23:25
Start Date: 10/Feb/20 23:25
Worklog Time Spent: 10m 
  Work Description: andeb commented on pull request #10825: [BEAM-9160] 
Update AWS SDK to support Pod Level Identity
URL: https://github.com/apache/beam/pull/10825
 
 
   Upgraded AWS SDK and added support to [pod 
identity](https://aws.amazon.com/blogs/opensource/introducing-fine-grained-iam-roles-service-accounts/)
 when running in AWS EKS.
   
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
 | --- | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/)
 | --- | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/)
   Python | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/)
 | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)[![Build