Re: Upgrade guava to 31.1-jre and remove hadoop2

2022-11-06 Thread Dongjoon Hyun
For dropping the `hadoop-2` profile, we need to discuss it further after releasing Apache Spark 3.4 and monitoring the adoption of 3.4. For now, we have no plan of dropping the `hadoop-2` profile yet because it's known to be used used in the community against the custom Hadoop 2 distributions (in

Re: Upgrade guava to 31.1-jre and remove hadoop2

2022-11-06 Thread Yang,Jie(INF)
Hi, Bjørn Currently, I don't think we can consider upgrading Guava for the following reasons: 1. Although Spark 3.4.0 will no longer release the hadoop-2 distribution, but the build and testing process is still running. We need to keep it and will not consider upgrading Guava until it is reall

Upgrade guava to 31.1-jre and remove hadoop2

2022-11-06 Thread Bjørn Jørgensen
Hi, anyone that has tried to upgrade guava now after we stop supporting hadoop2? And is there a plan for removing hadoop2 code from the code base?