[
https://issues.apache.org/jira/browse/HADOOP-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669115#comment-16669115
]
Steve Loughran commented on HADOOP-15888:
-----------------------------------------
Looks like table create time can be very slow, at least on S3 Ireland today.
This could be triggering test timeout before the delete operations kick off.
Further thoughts
* this must be a scale test, so that it picks up the longer timeout
* we need to make sure that whatever happens, the tables go away.
As it is, I'm now scared of this test. Certainly I'm not going to have it
running by default, though as a scale test it'll be less prone to timeouts.
[~gabor.bota] FYI
> ITestDynamoDBMetadataStore can leak (large) DDB tables in test
> failures/timeout
> -------------------------------------------------------------------------------
>
> Key: HADOOP-15888
> URL: https://issues.apache.org/jira/browse/HADOOP-15888
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3, test
> Affects Versions: 3.1.2
> Reporter: Steve Loughran
> Priority: Major
> Attachments: Screen Shot 2018-10-30 at 17.32.43.png
>
>
> This is me doing some backporting of patches from branch-3.2, so it may be an
> intermediate condition but
> # I'd noticed I wasn't actually running ITestDynamoDBMetadataStore
> # so I set it up to work with teh right config opts (table and region)
> # but the tests were timing out
> # looking at DDB tables in the AWS console showed a number of DDB tables
> "testProvisionTable", "testProvisionTable", created, each with "500 read, 100
> write capacity (i.e. ~$50/month)
> I haven't replicated this in trunk/branch-3.2 itself, but its clearly
> dangerous. At the very least, we should have a size of 1 R/W in all
> creations, so the cost of a test failure is neglible, and then we should
> document the risk and best practise.
> Also: use "s3guard" as the table prefix to make clear its origin
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
