This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 32dd961c36de [SPARK-60631][BUILD] Upgrade `scala-parallel-collections`
to 1.3.0
32dd961c36de is described below
commit 32dd961c36decf1d5f9799d0e87592d1dd94b939
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Oct 28 17:57:12 2026 -0700
[SPARK-60631][BUILD] Upgrade `scala-parallel-collections` to 1.3.0
### What changes were proposed in this pull request?
This PR aims to upgrade `scala-parallel-collections` from `1.2.0` to
`1.3.0`.
### Why are the changes needed?
To bring the latest improvements and keep the dependency up to date.
- https://github.com/scala/scala-parallel-collections/releases/tag/v1.3.0
(2026-10-22)
- Stabilise `OldHashSet` serialisation independent of the generated
classfile (scala/scala-parallel-collections#303)
- Update the parent type of `ParSeqLike`
(scala/scala-parallel-collections#308)
- Deprecate unused fields (scala/scala-parallel-collections#367)
- Compile the Scala 3 JVM artifact with `-Yfuture-lazy-vals`
(scala/scala-parallel-collections#362)
-
https://github.com/scala/scala-parallel-collections/compare/v1.2.0...v1.3.0
The new JDK 17 requirement applies only to the Scala 3 JVM artifact. Spark
uses the Scala 2.13 artifact, which is unaffected:
- The Scala 2.13 artifact is built with Scala `2.13.18`, the same as
Spark's Scala version.
- The class files in `scala-parallel-collections_2.13-1.3.0.jar` still
target Java 8 (class file version 52).
Spark only uses `ParVector`, `ParRange`, `ForkJoinTaskSupport`, and
`ExecutionContextTaskSupport` from this library (`UnionRDD`, `ddl.scala`,
`DStreamGraph`, `FileBasedWriteAheadLog`, and `SQLExecutionSuite`). It doesn't
use `ParSeqLike` or `OldHashSet` directly.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs. In addition, I verified locally that
`scala-parallel-collections_2.13-1.3.0.jar` is on the `core` test classpath,
that `streaming` and `sql` main/test sources compile without any warnings
related to parallel collections, and that the following suites covering the
usage sites pass:
- `core`: `RDDSuite` (79), `ThreadUtilsSuite` (15)
- `streaming`: `ReceivedBlockTrackerSuite` (7),
`FileBasedWriteAheadLogSuite` and
`FileBasedWriteAheadLogWithFileCloseAfterWriteSuite` (26)
- `sql`: `SQLExecutionSuite` and `v1.MsckRepairTableSuite` (19)
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Sonnet 5.5
Closes #59880 from dongjoon-hyun/SPARK-60631.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 2 +-
pom.xml | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 4c4652f34c72..dc2dd9bf2882 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -254,7 +254,7 @@ remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar
rocksdbjni/10.10.1.1//rocksdbjni-10.10.1.1.jar
scala-compiler/2.13.18//scala-compiler-2.13.18.jar
scala-library/2.13.18//scala-library-2.13.18.jar
-scala-parallel-collections_2.13/1.2.0//scala-parallel-collections_2.13-1.2.0.jar
+scala-parallel-collections_2.13/1.3.0//scala-parallel-collections_2.13-1.3.0.jar
scala-parser-combinators_2.13/2.4.0//scala-parser-combinators_2.13-2.4.0.jar
scala-reflect/2.13.18//scala-reflect-2.13.18.jar
scala-xml_2.13/2.5.0//scala-xml_2.13-2.5.0.jar
diff --git a/pom.xml b/pom.xml
index fd4430f780d2..8c70122051bc 100644
--- a/pom.xml
+++ b/pom.xml
@@ -486,7 +486,7 @@
<dependency>
<groupId>org.scala-lang.modules</groupId>
<artifactId>scala-parallel-collections_${scala.binary.version}</artifactId>
- <version>1.2.0</version>
+ <version>1.3.0</version>
</dependency>
<dependency>
<groupId>com.twitter</groupId>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
