[
https://issues.apache.org/jira/browse/HADOOP-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946678#comment-16946678
]
Steve Loughran commented on HADOOP-16642:
-----------------------------------------
The text we are looking for is actually one we create ourselves when we give up
retrying.
don't seem to match any branch (not even my own), there are two possibilities
here:
* the retry logic is no longer working.
* we have moved operations around so that the specific place whether throttling
is occurring is not wrapped by the exception translation.
The stack traces show the invoker retry loop was involved, so I go with
hypothesis #2.
It looks like the message is only added in {{retryBackoffOnBatchWrite}}; we are
not using batched writes at the point where the failure occurred, hence: not
wrapped.
Plan: stop looking for the text.
> ITestDynamoDBMetadataStoreScale failing as the error text does not match
> expectations
> -------------------------------------------------------------------------------------
>
> Key: HADOOP-16642
> URL: https://issues.apache.org/jira/browse/HADOOP-16642
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Priority: Major
>
> ITestDynamoDBMetadataStoreScale tries to create a scale test iff the table
> isn't PAYG. Its failing with the wrong text being returned.
> Proposed: don't look for any text
> {code}
> 13:06:22 java.lang.AssertionError:
> 13:06:22 Expected throttling message: Expected to find ' This may be because
> the write threshold of DynamoDB is set too low.'
> but got unexpected exception:
> org.apache.hadoop.fs.s3a.AWSServiceThrottledException:
> Put tombstone on s3a://fake-bucket/moved-here:
> com.amazonaws.services.dynamodbv2.model.ProvisionedThroughputExceededException:
>
> The level of configured provisioned throughput for the table was exceeded.
> Consider increasing your provisioning level with the UpdateTable API.
> (Service: AmazonDynamoDBv2; Status Code: 400; Error Code:
> ProvisionedThroughputExceededException;
> Request ID: L12H9UM7PE8K0ILPGGTF4QG367VV4KQNSO5AEMVJF66Q9ASUAAJG):
> The level of configured provisioned throughput for the table was exceeded.
> Consider increasing your provisioning level with the UpdateTable API.
> (Service: AmazonDynamoDBv2; Status Code: 400;
> Error Code: ProvisionedThroughputExceededException; Request ID:
> L12H9UM7PE8K0ILPGGTF4QG367VV4KQNSO5AEMVJF66Q9ASUAAJG)
> 13:06:22 at
> org.apache.hadoop.fs.s3a.S3AUtils.translateDynamoDBException(S3AUtils.java:402)
> 13
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
