This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 8d52490 [SPARK-57875] Exclude Hadoop `filecache` classes from shadow
jar
8d52490 is described below
commit 8d524902b26f424543da72bed1aa7afe281c6123
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Jul 1 22:57:51 2026 -0700
[SPARK-57875] Exclude Hadoop `filecache` classes from shadow jar
### What changes were proposed in this pull request?
This PR excludes the Hadoop `filecache` package
(`org/apache/hadoop/filecache/**`) from the
operator shadow jar by adding a class-path filter to the `shadowJar` block
in
`spark-operator/build.gradle`.
### Why are the changes needed?
The operator never uses Hadoop `DistributedCache`. While the `minimize`
step already drops the
unreferenced `DistributedCache` class, the package directory entry and
`package-info.class`
(from `hadoop-client-api`) still remain in the shadow jar. This change
removes those leftover
entries explicitly, consistent with the existing MapReduce exclusions.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Fable 5
Closes #734 from dongjoon-hyun/SPARK-57875.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
spark-operator/build.gradle | 1 +
1 file changed, 1 insertion(+)
diff --git a/spark-operator/build.gradle b/spark-operator/build.gradle
index 4779211..00524f0 100644
--- a/spark-operator/build.gradle
+++ b/spark-operator/build.gradle
@@ -102,6 +102,7 @@ shadowJar {
// Hadoop YARN classes - not used for K8s deployment
exclude("org/apache/hadoop/yarn/**")
// Hadoop MapReduce classes - not used for K8s deployment
+ exclude("org/apache/hadoop/filecache/**")
exclude("org/apache/hadoop/mapred/**")
exclude("org/apache/hadoop/mapreduce/**")
exclude("mapred-default.xml")
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
