dongjoon-hyun opened a new pull request, #59880: URL: https://github.com/apache/spark/pull/59880
### What changes were proposed in this pull request? This PR aims to upgrade `scala-parallel-collections` from `1.2.0` to `1.3.0`. ### Why are the changes needed? To bring the latest improvements and keep the dependency up to date. - https://github.com/scala/scala-parallel-collections/releases/tag/v1.3.0 (2026-10-22) - Stabilise `OldHashSet` serialisation independent of the generated classfile (scala/scala-parallel-collections#303) - Update the parent type of `ParSeqLike` (scala/scala-parallel-collections#308) - Deprecate unused fields (scala/scala-parallel-collections#367) - Compile the Scala 3 JVM artifact with `-Yfuture-lazy-vals` (scala/scala-parallel-collections#362) - https://github.com/scala/scala-parallel-collections/compare/v1.2.0...v1.3.0 The new JDK 17 requirement applies only to the Scala 3 JVM artifact. Spark uses the Scala 2.13 artifact, which is unaffected: - The Scala 2.13 artifact is built with Scala `2.13.18`, the same as Spark's Scala version. - The class files in `scala-parallel-collections_2.13-1.3.0.jar` still target Java 8 (class file version 52). Spark only uses `ParVector`, `ParRange`, `ForkJoinTaskSupport`, and `ExecutionContextTaskSupport` from this library (`UnionRDD`, `ddl.scala`, `DStreamGraph`, `FileBasedWriteAheadLog`, and `SQLExecutionSuite`). It doesn't use `ParSeqLike` or `OldHashSet` directly. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. In addition, I verified locally that `scala-parallel-collections_2.13-1.3.0.jar` is on the `core` test classpath, that `streaming` and `sql` main/test sources compile without any warnings related to parallel collections, and that the following suites covering the usage sites pass: - `core`: `RDDSuite` (79), `ThreadUtilsSuite` (15) - `streaming`: `ReceivedBlockTrackerSuite` (7), `FileBasedWriteAheadLogSuite` and `FileBasedWriteAheadLogWithFileCloseAfterWriteSuite` (26) - `sql`: `SQLExecutionSuite` and `v1.MsckRepairTableSuite` (19) ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Sonnet 5.5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
