[
https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787295#comment-15787295
]
Mingliang Liu commented on HADOOP-13908:
----------------------------------------
Tests in US-West-1 region with the DynamoDB table existent and nonexistent
before the tests.
{code}
Tests in error:
ITestS3AAWSCredentialsProvider.testAnonymousProvider:133 » AWSServiceIO
initTa...
ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101 » AWSServiceIO move:
com.a...
ITestS3ADeleteFilesOneByOne>ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101
» AWSServiceIO
ITestS3AFileSystemContract>FileSystemContractBaseTest.testRenameToDirWithSamePrefixAllowed...
ITestS3ACredentialsInURL.testInvalidCredentialsFail:127 » AccessDenied
s3a://m...
{code}
The failing tests seem not related and they fail without this patch.
{{ITestS3AAWSCredentialsProvider}} and {{ITestS3ACredentialsInURL}} we track in
[HADOOP-13876]. For the rename related three ones, I didn't seem them
consistently fail before though. I think they're related to [HADOOP-13934] and
hopefully it will address them.
> S3Guard: Existing tables may not be initialized correctly in
> DynamoDBMetadataStore
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-13908
> URL: https://issues.apache.org/jira/browse/HADOOP-13908
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: HADOOP-13345
> Reporter: Mingliang Liu
> Assignee: Mingliang Liu
> Attachments: HADOOP-13908-HADOOP-13345.000.patch,
> HADOOP-13908-HADOOP-13345.001.patch, HADOOP-13908-HADOOP-13345.002.patch,
> HADOOP-13908-HADOOP-13345.002.patch, HADOOP-13908-HADOOP-13345.003.patch
>
>
> This was based on discussion in [HADOOP-13455]. Though we should not create
> table unless the config {{fs.s3a.s3guard.ddb.table.create}} is set true, we
> still have to get the existing table in
> {{DynamoDBMetadataStore#initialize()}} and wait for its becoming active,
> before any table/item operations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]