ben-roling commented on issue #675: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/675#issuecomment-484590991 We had some offline discussion yesterday and one of the threads within that was testing. In talking I incorrectly described how I was testing the scenario where S3Guard metadata is out of sync with S3. I stated that in my tests I was writing to S3AFileSystem and then after the fact directly updating the metadata to be out of sync. There was a suggestion that an alternative would be to write through S3AFileSystem and then write again out of band so that the metadata from the second write doesn't go to S3Guard. I said I would add such a test. As it turns out, that's actually what I was already doing here. I think I had taken the approach I previously described in an earlier iteration of this but had since gone to the newer strategy so that I could test that the previous version is still available when using the object versionId based change detection with a bucket that has versioning enabled. The testing of this behavior can be seen in ITestS3ARemoteFileChanged.testReadFileChangedOutOfSyncMetadata().
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
