ben-roling commented on issue #675: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/675#issuecomment-484683392 I did a test run against us-west-2: ``` mvn -T 1C verify -Dparallel-tests -DtestsThreadCount=8 -Ds3guard -Ddynamo ``` To be transparent, I cherry-picked in https://github.com/apache/hadoop/pull/742/commits/d872ff28843180f7be6a5ee97ea72e61f5fb8c98 so I could use a prefix grant to get my user access to the necessary tables. I won't push that commit to this branch though. Hopefully it will get merged into trunk soon. A few tests failed on the initial run: ``` [ERROR] Failures: [ERROR] ITestS3AFileSystemContract>FileSystemContractBaseTest.testListStatus:309 expected:<1> but was:<2> [ERROR] Errors: [ERROR] ITestS3AContractGetFileStatusV1List>AbstractContractGetFileStatusTest.testComplexDirActions:149->AbstractContractGetFileStatusTest.checkListFilesComplexDirRecursive:245->AbstractContractGetFileStatusTest.verifyFileStats:435 » TestTimedOut [ERROR] ITestS3GuardListConsistency.testConsistentRenameAfterDelete:244 » FileNotFound [ERROR] ITestDirectoryCommitMRJob>AbstractITCommitMRJob.testMRJob:133->AbstractFSContractTestBase.assertIsDirectory:327 » FileNotFound [ERROR] ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testPruneCommandCLI:299->AbstractS3GuardToolTestBase.testPruneCommand:284 » TestTimedOut [INFO] [ERROR] Tests run: 858, Failures: 1, Errors: 4, Skipped: 145 ``` Rerunning them each individually, they passed: ``` mvn -T 1C verify -Dtest=skip -Dit.test=ITestS3AFileSystemContract -Ds3guard -Ddynamo mvn -T 1C verify -Dtest=skip -Dit.test=ITestS3AContractGetFileStatusV1List -Ds3guard -Ddynamo mvn -T 1C verify -Dtest=skip -Dit.test=ITestS3GuardListConsistency -Ds3guard -Ddynamo mvn -T 1C verify -Dtest=skip -Dit.test=ITestDirectoryCommitMRJob -Ds3guard -Ddynamo mvn -T 1C verify -Dtest=skip -Dit.test=ITestS3GuardToolDynamoDB -Ds3guard -Ddynamo ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
