dongjoon-hyun opened a new pull request #29895: URL: https://github.com/apache/spark/pull/29895
### What changes were proposed in this pull request? This PR aims to use a consistent and safe version of Apache Hadoop file output committer algorithm. ### Why are the changes needed? Apache Spark provides multiple distributions with Hadoop 2.7 and Hadoop 3.2. Apache Hadoop 3.0 switches the default algorithm from v1 to v2 and now they are discussion of removing v2. We had better provide a consistent default behavior. ### Does this PR introduce _any_ user-facing change? Yes. This changes the default behavior. Users can override this conf. ### How was this patch tested? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
