[
https://issues.apache.org/jira/browse/HADOOP-19748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-19748.
-------------------------------------
Fix Version/s: 3.5.0
3.4.3
Resolution: Fixed
> S3A: ITestAssumeRole tests failing now STS returns detailed error messages
> --------------------------------------------------------------------------
>
> Key: HADOOP-19748
> URL: https://issues.apache.org/jira/browse/HADOOP-19748
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.5.0, 3.4.2
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Fix For: 3.5.0, 3.4.3
>
>
> STS is now providing detail on why malformed JSON role specifications are
> invalid;
> breaks text a couple of tests are looking for
> {code}
>
> ITestAssumeRole.testAssumeRoleFSBadPolicy:251->expectFileSystemCreateFailure:164
> Expected to find 'JSON' but got unexpected exception:
> org.apache.hadoop.fs.s3a.AWSBadRequestException: Instantiate
> org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider on /:
> software.amazon.awssdk.services.sts.model.MalformedPolicyDocumentException:
> Unexpected IOException: Unexpected close marker '}': expected ']' (for ROOT
> starting at [Source: java.io.StringReader@16a63c4d; line: 1, column: 0])
>
>
> at [Source: java.io.StringReader@16a63c4d; line: 1, column: 2] (Service:
> Sts, Status Code: 400, Request ID: 47f1da5d-c400-4269-866a-7324cb167a1a) (SDK
> Attempt Count: 1):MalformedPolicyDocument: Unexpected IOException: Unexpected
> close marker '}': expected ']' (for ROOT starting at [Source:
> java.io.StringReader@16a63c4d; line: 1, column: 0])
>
> at [Source: java.io.StringReader@16a63c4d; line: 1, column: 2] (Service:
> Sts, Status Code: 400, Request ID: 47f1da5d-c400-4269-866a-7324cb167a1a) (SDK
> Attempt Count: 1)
> at
> org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:271)
>
>
> at
> org.apache.hadoop.fs.s3a.S3AUtils.getInstanceFromReflection(S3AUtils.java:705)
>
>
> at
> org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.createAWSV2CredentialProvider(CredentialProviderListFactory.java:303)
>
> at
> org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.buildAWSProviderList(CredentialProviderListFactory.java:249)
>
> at
> org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.createAWSCredentialProviderList(CredentialProviderListFactory.java:142)
>
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.createClientManager(S3AFileSystem.java:1151)
>
>
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:729)
>
>
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3616)
>
>
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555)
>
>
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:373)
>
>
> at
> org.apache.hadoop.fs.s3a.auth.ITestAssumeRole.lambda$expectFileSystemCreateFailure$0(ITestAssumeRole.java:166)
>
> at
> org.apache.hadoop.fs.s3a.S3ATestUtils.lambda$interceptClosing$0(S3ATestUtils.java:753)
>
> {code}
> {code}
>
> ITestAssumeRole.testAssumeRoleFSBadPolicy2:262->expectFileSystemCreateFailure:164
> Expected to find 'Syntax errors in policy' but got unexpected exception:
> org.apache.hadoop.fs.s3a.AWSBadRequestException: Instantiate
> org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider on /:
> software.amazon.awssdk.services.sts.model.MalformedPolicyDocumentException:
> Unexpected IOException: Unexpected character (''' (code 39)): was expecting
> double-quote to start field name
>
> at [Source: java.io.StringReader@21d2e81f; line: 1, column: 3] (Service:
> Sts, Status Code: 400, Request ID: 7b22250d-1238-4609-92f2-280531aacf11) (SDK
> Attempt Count: 1):MalformedPolicyDocument: Unexpected IOException: Unexpected
> character (''' (code 39)): was expecting double-quote to start field name
>
>
> at [Source: java.io.StringReader@21d2e81f; line: 1, column: 3] (Service:
> Sts, Status Code: 400, Request ID: 7b22250d-1238-4609-92f2-280531aacf11) (SDK
> Attempt Count: 1)
> {code}
> Fix: only look for MalformedPolicyDocument string
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
