sunchao commented on pull request #30891: URL: https://github.com/apache/spark/pull/30891#issuecomment-755454775
Thanks for bringing this up - I was not aware of the history there. @dongjoon-hyun do you know why we removed all the other Hadoop profiles? I'm not sure if Spark community has intention to support another Hadoop 2.x version in future since at one point there was discussion to deprecate Hadoop 2.7, as Hadoop 2.x lines have mostly reached their EOL. On the other hand, I'm hoping that with shaded Hadoop client [(SPARK-33212](https://issues.apache.org/jira/browse/SPARK-33212)) we can avoid the dependency tweaks in separate Hadoop profiles. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
