Re: Dropping Apache Spark Hadoop2 Binary Distribution?

2022-10-04 Thread Dongjoon Hyun
Thank you for your feedback and support, YangJie and Steve. For the internally-built Hadoop clusters, I believe internally-built Spark distribution with the corresponding custom Hadoop will be the best solution instead of Apache Spark with Apache Hadoop 2.7.4 client to have the full internal

Re: Dropping Apache Spark Hadoop2 Binary Distribution?

2022-10-04 Thread Dongjoon Hyun
Yes, it's yours. I added you (Steve Loughran ) as BCC at the first email, Steve. :) Dongjoon. On Tue, Oct 4, 2022 at 6:24 AM Steve Loughran wrote: > > that sounds suspiciously like something I'd write :) > > the move to java8 happened in HADOOP-11858; 3.0.0 > > HADOOP-16219, "[JDK8] Set

Re: Dropping Apache Spark Hadoop2 Binary Distribution?

2022-10-04 Thread Steve Loughran
that sounds suspiciously like something I'd write :) the move to java8 happened in HADOOP-11858; 3.0.0 HADOOP-16219, "[JDK8] Set minimum version of Hadoop 2 to JDK 8" has been open since 2019 and I just closed as WONTFIX. Most of the big production hadoop 2 clusters use java7, because that is