This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 6decc41 [SPARK-55676] Upgrade Hadoop to 3.4.3
6decc41 is described below
commit 6decc41b1f938668282fd81777b0995a2fc95113
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue Feb 24 22:05:41 2026 -0800
[SPARK-55676] Upgrade Hadoop to 3.4.3
### What changes were proposed in this pull request?
This PR aims to upgrade Hadoop to 3.4.3 instead of the transitive one from
the Apache Spark 4.1.1.
### Why are the changes needed?
Apache Hadoop 3.4.3 supports Java 25 better.
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Pass the CIs.
Manually check like the following.
**BEFORE**
```bash
$ gradle spark-operator:dependencyInsight --configuration compileClasspath
--dependency org.apache.hadoop | grep '^org.apache.hadoop' | awk -F: '{print
$NF}' | sort | uniq -c
4 3.4.2
```
**AFTER**
```bash
$ gradle spark-operator:dependencyInsight --configuration compileClasspath
--dependency org.apache.hadoop | grep '^org.apache.hadoop' | awk -F: '{print
$NF}' | sort | uniq -c
2 3.4.2 -> 3.4.3
2 3.4.3 (selected by rule)
```
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: `Gemini 3.1 Pro (High)` on `Antigravity`
Closes #521 from dongjoon-hyun/SPARK-55676.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
build.gradle | 3 +++
gradle/libs.versions.toml | 1 +
2 files changed, 4 insertions(+)
diff --git a/build.gradle b/build.gradle
index 7eeee12..940beb5 100644
--- a/build.gradle
+++ b/build.gradle
@@ -75,6 +75,9 @@ subprojects {
if (requested.group == "io.netty" &&
!requested.name.startsWith("netty-tcnative")) {
useVersion(libs.versions.netty.get())
}
+ if (requested.group == "org.apache.hadoop") {
+ useVersion(libs.versions.hadoop.get())
+ }
}
}
diff --git a/gradle/libs.versions.toml b/gradle/libs.versions.toml
index 81fb78f..ce896e6 100644
--- a/gradle/libs.versions.toml
+++ b/gradle/libs.versions.toml
@@ -21,6 +21,7 @@ netty = "4.2.10.Final"
operator-sdk = "5.2.2"
dropwizard-metrics = "4.2.37"
spark = "4.1.1"
+hadoop = "3.4.3"
log4j = "2.24.3"
slf4j = "2.0.17"
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
