[ 
https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787295#comment-15787295
 ] 

Mingliang Liu commented on HADOOP-13908:
----------------------------------------

Tests in US-West-1 region with the DynamoDB table existent and nonexistent 
before the tests.
{code}
Tests in error:
  ITestS3AAWSCredentialsProvider.testAnonymousProvider:133 » AWSServiceIO 
initTa...
  ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101 » AWSServiceIO move: 
com.a...
  
ITestS3ADeleteFilesOneByOne>ITestS3ADeleteManyFiles.testBulkRenameAndDelete:101 
» AWSServiceIO
  
ITestS3AFileSystemContract>FileSystemContractBaseTest.testRenameToDirWithSamePrefixAllowed...
  ITestS3ACredentialsInURL.testInvalidCredentialsFail:127 » AccessDenied 
s3a://m...
{code}
The failing tests seem not related and they fail without this patch. 
{{ITestS3AAWSCredentialsProvider}} and {{ITestS3ACredentialsInURL}} we track in 
[HADOOP-13876]. For the rename related three ones, I didn't seem them 
consistently fail before though. I think they're related to [HADOOP-13934] and 
hopefully it will address them.

> S3Guard: Existing tables may not be initialized correctly in 
> DynamoDBMetadataStore
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-13908
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13908
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: HADOOP-13345
>            Reporter: Mingliang Liu
>            Assignee: Mingliang Liu
>         Attachments: HADOOP-13908-HADOOP-13345.000.patch, 
> HADOOP-13908-HADOOP-13345.001.patch, HADOOP-13908-HADOOP-13345.002.patch, 
> HADOOP-13908-HADOOP-13345.002.patch, HADOOP-13908-HADOOP-13345.003.patch
>
>
> This was based on discussion in [HADOOP-13455]. Though we should not create 
> table unless the config {{fs.s3a.s3guard.ddb.table.create}} is set true, we 
> still have to get the existing table in 
> {{DynamoDBMetadataStore#initialize()}} and wait for its becoming active, 
> before any table/item operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to