[
https://issues.apache.org/jira/browse/HADOOP-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564515#comment-16564515
]
Steve Loughran commented on HADOOP-15642:
-----------------------------------------
Patch 003 (skipped 002)
* new AWS SDK is out, so update to 1.11.375; walk through the update
qualification process to see how it works. Fine, just slow, especially looking
through the output, where this time I only did a subset of the output.txt files
(the seek ones)
* added some more hadoop fs & s3guard commands to help validate stuff.
Test run with s3guard, ddb and auth against US-west-1
saw the (known) failure
ITestS3AFileContextMainOperations>FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile
Also got a diff failure in ITestS3GuardToolLocal; not sure if that is new or
not, but as its the first time I've run auth for a while, assuming unrelated
while I look at it
> Update to latest/recent version of aws-sdk for Hadoop 3.2
> ---------------------------------------------------------
>
> Key: HADOOP-15642
> URL: https://issues.apache.org/jira/browse/HADOOP-15642
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build, fs/s3
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Blocker
> Attachments: HADOOP-15642-001.patch, HADOOP-15642-003.patch, Screen
> Shot 2018-07-30 at 14.11.22.png
>
>
> Move to a later version of the AWS SDK library for a different set of
> features and issues.
> proposed version: 1.11.375
> One thing which doesn't work on the one we ship with is the ability to create
> assumed role sessions >1h, as there's a check in the client lib for
> role-duration <= 3600 seconds. I'll assume more recent SDKs delegate duration
> checks to the far end.
> see:
> [https://aws.amazon.com/about-aws/whats-new/2018/03/longer-role-sessions/]
> * assuming later versions will extend assumed role life, docs will need
> changing,
> * Adding a test in HADOOP-15583 which expects an error message if you ask for
> a duration of 3h; this should act as the test to see what happens.
> * think this time would be good to explicitly write down the SDK update
> process
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
