This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 736d8ab3f00e [SPARK-47049][BUILD] Ban non-shaded Hadoop dependencies
736d8ab3f00e is described below
commit 736d8ab3f00e7c5ba1b01c22f6398b636b8492ea
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Feb 14 14:30:40 2024 -0800
[SPARK-47049][BUILD] Ban non-shaded Hadoop dependencies
### What changes were proposed in this pull request?
This PR aims to ban `non-shaded` Hadoop dependencies (including transitive
ones).
### Why are the changes needed?
SPARK-33212 moved to shaded Hadoop dependencies at Apache Spark 3.2.0. This
PR will make it sure that we don't have any accidental leftovers.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45106 from dongjoon-hyun/SPARK-47049.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
pom.xml | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/pom.xml b/pom.xml
index 0b6a6955b18b..b83378af30ff 100644
--- a/pom.xml
+++ b/pom.xml
@@ -2869,6 +2869,10 @@
</requireJavaVersion>
<bannedDependencies>
<excludes>
+ <exclude>org.apache.hadoop:hadoop-common</exclude>
+ <exclude>org.apache.hadoop:hadoop-hdfs-client</exclude>
+
<exclude>org.apache.hadoop:hadoop-mapreduce-client-core</exclude>
+
<exclude>org.apache.hadoop:hadoop-mapreduce-client-jobclient</exclude>
<exclude>org.jboss.netty</exclude>
<exclude>org.codehaus.groovy</exclude>
<exclude>*:*_2.12</exclude>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
