This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new fe09e466f [CELEBORN-1262] Bump Spark from 3.3.3 to 3.3.4
fe09e466f is described below
commit fe09e466f3a6e1b2fb01b543f5dd0e5c220049de
Author: SteNicholas <[email protected]>
AuthorDate: Sun Feb 4 14:33:33 2024 +0800
[CELEBORN-1262] Bump Spark from 3.3.3 to 3.3.4
### What changes were proposed in this pull request?
Bump Spark from 3.3.3 to 3.3.4. Meanwhile, bump the default `spark.version`
from 3.3.2 to 3.3.4.
### Why are the changes needed?
Spark 3.3.4 has been announced to release: [Spark 3.3.4
released](https://spark.apache.org/news/spark-3-3-4-released.html). The profile
spark-3.3 could bump Spark from 3.3.3 to 3.3.4.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
No.
Closes #2284 from SteNicholas/CELEBORN-1262.
Authored-by: SteNicholas <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
pom.xml | 4 ++--
project/CelebornBuild.scala | 2 +-
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/pom.xml b/pom.xml
index c784b0888..a0af02c6b 100644
--- a/pom.xml
+++ b/pom.xml
@@ -65,7 +65,7 @@
<maven.version>3.8.8</maven.version>
<flink.version>1.14.6</flink.version>
- <spark.version>3.3.2</spark.version>
+ <spark.version>3.3.4</spark.version>
<!-- use hadoop-3 as default -->
<hadoop.version>3.3.6</hadoop.version>
@@ -1144,7 +1144,7 @@
<lz4-java.version>1.8.0</lz4-java.version>
<scala.version>2.12.15</scala.version>
<scala.binary.version>2.12</scala.binary.version>
- <spark.version>3.3.3</spark.version>
+ <spark.version>3.3.4</spark.version>
<zstd-jni.version>1.5.2-1</zstd-jni.version>
</properties>
</profile>
diff --git a/project/CelebornBuild.scala b/project/CelebornBuild.scala
index 67a355fd3..4c3f34626 100644
--- a/project/CelebornBuild.scala
+++ b/project/CelebornBuild.scala
@@ -581,7 +581,7 @@ object Spark33 extends SparkClientProjects {
val sparkProjectScalaVersion = "2.12.15"
// scalaBinaryVersion
// val scalaBinaryVersion = "2.12"
- val sparkVersion = "3.3.3"
+ val sparkVersion = "3.3.4"
val zstdJniVersion = "1.5.2-1"
override val includeColumnarShuffle: Boolean = true
