steveloughran commented on issue #1845: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1845#issuecomment-585758485 Created a new class org.apache.hadoop.fs.s3a.impl.ErrorTranslation; future work related to mapping from AWS exceptions to IOEs&C can go in there rather than S3AUtils. Moved the checks for an AmazonServiceException being caused by a missing bucket to there; this cleans up uses of the probe. Add a unit test for the recognition/translation. test run: all good except for an intermittent problem I've been seeing with the terasorts where the YARN resource localizer is failing as there's a mismatch between file timestamps...people shouldn't be using S3A as the yarn FS,
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
