Hi all,
It’s time for our quarterly report to the board again, due next Wednesday.
Here’s a draft, lmk about any suggestions:
=========================
Project Status:
- Apache Spark 4.2.0 is currently in the QA phase
- Released Apache Spark 4.2.0-preview5 on May 2, 2026.
- Released Apache Spark Connect Swift Client 0.6.0 on Apr 10, 2026.
- Released Apache Spark 4.2.0-preview4 on Apr 8, 2026.
- Released Apache Spark Kubernetes Operator 0.8.0 on Mar 15, 2026.
- Released Apache Spark 4.2.0-preview3 on Mar 13, 2026.
- Several SPIPs were accepted since the previous report:
a. Extending the Spark 3.5 LTS Period With Security Fixes
b. DSV2 Enhanced Partition Stats Filtering
c. Change Data Capture (CDC) Support
d. Auto CDC Support for Apache Spark
e. Unified UDF Execution Protocol and Worker Specification for
Multi-Language UDFs
- Notable changes adopted by community:
- GitHub Issues opened as an experimental issue-tracking option alongside
JIRA
- A buffer / grace period before adopting upstream dependency upgrades
- Drop support for PyPy in PySpark
- Replacing black with ruff as the Python formatter
Trademarks:
- No changes since last report.
Latest releases:
- Spark 4.0.2 was released on Feb 5, 2026
- Spark 3.5.8 was released on Jan 23, 2026
- Spark 4.1.1 was released on Jan 9, 2026
Committers and PMC:
- The latest committer was added on Feb 9, 2026 (Cheng Pan).
- The latest PMC member was added on Jan 21, 2025 (Jie Yang).
=========================
---------------------------------------------------------------------
To unsubscribe e-mail: [email protected]
