Steve Loughran created HADOOP-19748:
---------------------------------------
Summary: S3A: ITestAssumeRole tests failing now STS returns
detailed error messages
Key: HADOOP-19748
URL: https://issues.apache.org/jira/browse/HADOOP-19748
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3, test
Affects Versions: 3.4.2, 3.5.0
Reporter: Steve Loughran
Assignee: Steve Loughran
STS is now providing detail on why malformed JSON role specifications are
invalid;
breaks text a couple of tests are looking for
{code}
ITestAssumeRole.testAssumeRoleFSBadPolicy:251->expectFileSystemCreateFailure:164
Expected to find 'JSON' but got unexpected exception:
org.apache.hadoop.fs.s3a.AWSBadRequestException: Instantiate
org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider on /:
software.amazon.awssdk.services.sts.model.MalformedPolicyDocumentException:
Unexpected IOException: Unexpected close marker '}': expected ']' (for ROOT
starting at [Source: java.io.StringReader@16a63c4d; line: 1, column: 0])
at [Source: java.io.StringReader@16a63c4d; line: 1, column: 2] (Service: Sts,
Status Code: 400, Request ID: 47f1da5d-c400-4269-866a-7324cb167a1a) (SDK
Attempt Count: 1):MalformedPolicyDocument: Unexpected IOException: Unexpected
close marker '}': expected ']' (for ROOT starting at [Source:
java.io.StringReader@16a63c4d; line: 1, column: 0])
at [Source: java.io.StringReader@16a63c4d; line: 1, column: 2] (Service: Sts,
Status Code: 400, Request ID: 47f1da5d-c400-4269-866a-7324cb167a1a) (SDK
Attempt Count: 1)
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:271)
at
org.apache.hadoop.fs.s3a.S3AUtils.getInstanceFromReflection(S3AUtils.java:705)
at
org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.createAWSV2CredentialProvider(CredentialProviderListFactory.java:303)
at
org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.buildAWSProviderList(CredentialProviderListFactory.java:249)
at
org.apache.hadoop.fs.s3a.auth.CredentialProviderListFactory.createAWSCredentialProviderList(CredentialProviderListFactory.java:142)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.createClientManager(S3AFileSystem.java:1151)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:729)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3616)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:373)
at
org.apache.hadoop.fs.s3a.auth.ITestAssumeRole.lambda$expectFileSystemCreateFailure$0(ITestAssumeRole.java:166)
at
org.apache.hadoop.fs.s3a.S3ATestUtils.lambda$interceptClosing$0(S3ATestUtils.java:753)
{code}
{code}
ITestAssumeRole.testAssumeRoleFSBadPolicy2:262->expectFileSystemCreateFailure:164
Expected to find 'Syntax errors in policy' but got unexpected exception:
org.apache.hadoop.fs.s3a.AWSBadRequestException: Instantiate
org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider on /:
software.amazon.awssdk.services.sts.model.MalformedPolicyDocumentException:
Unexpected IOException: Unexpected character (''' (code 39)): was expecting
double-quote to start field name
at [Source: java.io.StringReader@21d2e81f; line: 1, column: 3] (Service: Sts,
Status Code: 400, Request ID: 7b22250d-1238-4609-92f2-280531aacf11) (SDK
Attempt Count: 1):MalformedPolicyDocument: Unexpected IOException: Unexpected
character (''' (code 39)): was expecting double-quote to start field name
at [Source: java.io.StringReader@21d2e81f; line: 1, column: 3] (Service: Sts,
Status Code: 400, Request ID: 7b22250d-1238-4609-92f2-280531aacf11) (SDK
Attempt Count: 1)
{code}
Fix: only look for MalformedPolicyDocument string
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
