This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new 736d8ab3f00e [SPARK-47049][BUILD] Ban non-shaded Hadoop dependencies 736d8ab3f00e is described below commit 736d8ab3f00e7c5ba1b01c22f6398b636b8492ea Author: Dongjoon Hyun <dh...@apple.com> AuthorDate: Wed Feb 14 14:30:40 2024 -0800 [SPARK-47049][BUILD] Ban non-shaded Hadoop dependencies ### What changes were proposed in this pull request? This PR aims to ban `non-shaded` Hadoop dependencies (including transitive ones). ### Why are the changes needed? SPARK-33212 moved to shaded Hadoop dependencies at Apache Spark 3.2.0. This PR will make it sure that we don't have any accidental leftovers. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #45106 from dongjoon-hyun/SPARK-47049. Authored-by: Dongjoon Hyun <dh...@apple.com> Signed-off-by: Dongjoon Hyun <dh...@apple.com> --- pom.xml | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/pom.xml b/pom.xml index 0b6a6955b18b..b83378af30ff 100644 --- a/pom.xml +++ b/pom.xml @@ -2869,6 +2869,10 @@ </requireJavaVersion> <bannedDependencies> <excludes> + <exclude>org.apache.hadoop:hadoop-common</exclude> + <exclude>org.apache.hadoop:hadoop-hdfs-client</exclude> + <exclude>org.apache.hadoop:hadoop-mapreduce-client-core</exclude> + <exclude>org.apache.hadoop:hadoop-mapreduce-client-jobclient</exclude> <exclude>org.jboss.netty</exclude> <exclude>org.codehaus.groovy</exclude> <exclude>*:*_2.12</exclude> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org