sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-705709693
@HeartSaVioR that is great to hear. > Btw is there any discussion around having Hadoop 2.x? 2.7.4 is definitely EOL but no one intends to upgrade it. I think there was some in the past but we'll need another round of discussion on this, and yes agree with you that Spark shouldn't stay on 2.7 for any longer. In fact the only branch in Hadoop 2.x that is not EOL is 2.10.x, and that is a bridging release to make 3.x migration easier. Perhaps for futuristic looking we should consider removing the 2.x profile and only keep 3.x in Spark. Communicating with Hadoop 2.x server-side should still be fine since 3.x clients maintain backward-compatibility with 2.x IIRC. cc @srowen @HyukjinKwon @steveloughran @dbtsai @dongjoon-hyun for more thoughts on this. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
