steveloughran commented on PR #37225: URL: https://github.com/apache/spark/pull/37225#issuecomment-1211914699
I just want to highlight here that the move to using the client builder apis in the s3a client (HADOOP-13551) was one of the most traumatic regressions of recent years because all test systems met one or more of the conditions under which things actually worked (in EC2, explicit region set in client config or with AWS CLI installed) hence: https://issues.apache.org/jira/browse/HADOOP-17771 review the code very carefully here to make sure that there are no new options which are now mandatory except in those same deployment environments where are the S3A code actually worked. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
