ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493531516 I pushed a fast-forward to the latest commit from #824 into this PR. Also, I completed my first full test suite run against a bucket with versioning disabled: ``` mvn -T 1C verify -Dparallel-tests -DtestsThreadCount=8 -Ds3guard -Ddynamo ``` ``` [INFO] Results: [INFO] [ERROR] Failures: [ERROR] ITestS3AMiscOperations.testEmptyFileChecksums:147->Assert.assertEquals:118->Assert.failNotEquals:834->Assert.fail:88 checksums expected:<etag: "e1cdb893a982e62a4de587b1e3cbf7fb"> but was:<etag: "bc7a796a8fb5cd2d8bcf7f3c6479c188"> [ERROR] ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted:199->Assert.assertEquals:118->Assert.failNotEquals:834->Assert.fail:88 checksums expected:<etag: "d96315e900853a75d6e4998a48a23c66"> but was:<etag: "52ce70aa15620acd1703adcc8dff8a91"> [ERROR] Errors: [ERROR] ITestDirectoryCommitMRJob>AbstractITCommitMRJob.testMRJob:133->AbstractFSContractTestBase.assertIsDirectory:327 ยป FileNotFound [INFO] [ERROR] Tests run: 933, Failures: 2, Errors: 1, Skipped: 205 ``` The failures in ITestS3AMiscOperations seem to be related to the fact that I recently turned on default encryption on the bucket (to quiet some warnings I was getting from some best practice auditing my org does against buckets). I turned that back off and re-ran that test individually and it succeeded. I'll log a new JIRA to track that. ``` mvn -T 1C verify -Dtest=skip -Dit.test=ITestS3AMiscOperations -Ds3guard -Ddynamo ``` The failure from ITestDirectoryCommitMRJob is one that has been discussed before. Re-running that test individually yielded success. ``` mvn -T 1C verify -Dtest=skip -Dit.test=ITestDirectoryCommitMRJob -Ds3guard -Ddynamo ``` Now I'll run the suite one more time against a bucket with versioning enabled.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
