ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-491343173 > I'll be investigating the listing issue first. The listing doesn't return the eTag because innerListFiles() calls listing.createFileStatusListingIterator() which reconciles the native S3 listing against the S3Guard listing and the implementation of that (in Listing.FileStatusListingIterator.next()) prefers the native S3 listing S3AFileStatus over the S3Guard status. This used to make sense since when a file existed in both S3 and S3Guard, S3Guard probably wouldn't have had any better information about the file. With these changes, we should be preferring the status from S3Guard just as we do on file open.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
