This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 891f3eb [SPARK-57799] Exclude `net.razorvine` dependency
891f3eb is described below
commit 891f3ebfdfe84d2ad1793d0b83350608289d010a
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue Jun 30 22:00:46 2026 -0700
[SPARK-57799] Exclude `net.razorvine` dependency
### What changes were proposed in this pull request?
This PR excludes the `net.razorvine` dependency (transitively pulled in by
Spark) from `spark-submission-worker` (`spark-kubernetes`) and `spark-operator`
(`spark-core`).
### Why are the changes needed?
`net.razorvine:pickle` is a PySpark serialization library that the operator
never uses. Excluding it removes an unnecessary dependency from the runtime
classpath and shaded jar.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 4.8
This patch had conflicts when merged, resolved by
Committer: Dongjoon Hyun <[email protected]>
Closes #725 from dongjoon-hyun/SPARK-57799.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
spark-operator/build.gradle | 1 +
spark-submission-worker/build.gradle | 1 +
2 files changed, 2 insertions(+)
diff --git a/spark-operator/build.gradle b/spark-operator/build.gradle
index 78ad3e7..716dda0 100644
--- a/spark-operator/build.gradle
+++ b/spark-operator/build.gradle
@@ -43,6 +43,7 @@ dependencies {
exclude group: "com.ibm.icu"
exclude group: "commons-codec"
exclude group: "commons-collections", module: "commons-collections"
+ exclude group: "net.razorvine"
exclude group: "org.apache.commons", module: "commons-compress"
exclude group: "org.apache.logging.log4j"
exclude group: "org.checkerframework"
diff --git a/spark-submission-worker/build.gradle
b/spark-submission-worker/build.gradle
index 24e9863..e3e6358 100644
--- a/spark-submission-worker/build.gradle
+++ b/spark-submission-worker/build.gradle
@@ -31,6 +31,7 @@ dependencies {
exclude group: "commons-collections", module: "commons-collections"
exclude group: "io.fabric8"
exclude group: "net.sf.py4j"
+ exclude group: "net.razorvine"
exclude group: "org.apache.avro"
exclude group: "org.apache.commons", module: "commons-compress"
exclude group: "org.apache.logging.log4j"
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
