[ https://issues.apache.org/jira/browse/HADOOP-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564515#comment-16564515 ]
Steve Loughran commented on HADOOP-15642: ----------------------------------------- Patch 003 (skipped 002) * new AWS SDK is out, so update to 1.11.375; walk through the update qualification process to see how it works. Fine, just slow, especially looking through the output, where this time I only did a subset of the output.txt files (the seek ones) * added some more hadoop fs & s3guard commands to help validate stuff. Test run with s3guard, ddb and auth against US-west-1 saw the (known) failure ITestS3AFileContextMainOperations>FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile Also got a diff failure in ITestS3GuardToolLocal; not sure if that is new or not, but as its the first time I've run auth for a while, assuming unrelated while I look at it > Update to latest/recent version of aws-sdk for Hadoop 3.2 > --------------------------------------------------------- > > Key: HADOOP-15642 > URL: https://issues.apache.org/jira/browse/HADOOP-15642 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/s3 > Affects Versions: 3.2.0 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Blocker > Attachments: HADOOP-15642-001.patch, HADOOP-15642-003.patch, Screen > Shot 2018-07-30 at 14.11.22.png > > > Move to a later version of the AWS SDK library for a different set of > features and issues. > proposed version: 1.11.375 > One thing which doesn't work on the one we ship with is the ability to create > assumed role sessions >1h, as there's a check in the client lib for > role-duration <= 3600 seconds. I'll assume more recent SDKs delegate duration > checks to the far end. > see: > [https://aws.amazon.com/about-aws/whats-new/2018/03/longer-role-sessions/] > * assuming later versions will extend assumed role life, docs will need > changing, > * Adding a test in HADOOP-15583 which expects an error message if you ask for > a duration of 3h; this should act as the test to see what happens. > * think this time would be good to explicitly write down the SDK update > process -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org