It’s time for our quarterly report to the board again, due next Wednesday. I’ve updated our report format to the one used by a newer version of the ASF report wizard because the ASF now wants certain standard “keywords” such as project status. Here’s a draft, let me know if you have any suggestions:
==================================== ## Description: The mission of Spark is the creation and maintenance of software related to large-scale data processing and machine learning. ## Project Status: - Project state: Ongoing, with high activity. We made six software releases in the last quarter and added four committers and one PMC member. - Issues for the board: None. - We started using https://reporter.apache.org/ instead of the Board Agenda Tool to organize our report, so hopefully it will have the expected sections now, but let us know if anything is missing. ## Membership Data: Apache Spark was founded 2014-02-18 (12 years ago) There are currently 103 committers and 65 PMC members in this project. The Committer-to-PMC ratio is roughly 7:5. Community changes, past quarter: - Peter Toth was added to the PMC on 2026-05-20 - Tian Gao was added as committer on 2026-05-28 - Szehon Ho was added as committer on 2026-05-28 - Uroš Bojanić was added as committer on 2026-06-02 - Yicong Huang was added as committer on 2026-05-26 ## Project Activity: - The Spark 4.3 release branch has been cut. Spark 4.3 is the first feature release under the new quarterly release cadence, with QA planned for mid-August and release candidates planned for late August. - The following major Spark Improvement Proposals (SPIPs) were accepted through public discussions and votes. a. NEAREST BY Top-K Ranking Join b. Faster queries in local laptop mode for Apache Spark c. Timestamps with nanosecond precision d. OIDC Credential Propagation e. Write schema narrowing for column-level UPDATE and MERGE in DSv2 f. Cloud Credential Refresh and Distribution Without Kerberos - Releases in the past quarter: - Apache Spark Kubernetes Operator 1.0.0 was released on Jul 26, 2026. This was the first stable release of the Kubernetes operator. - Apache Spark Connect Swift Client 0.7.0 was released on Jul 25, 2026. - Apache Spark 3.5.9 was released on Jul 16, 2026. - Apache Spark 4.1.3 was released on Jul 15, 2026. - Apache Spark 4.0.4 was released on Jul 15, 2026. - Apache Spark 4.2.0 was released on Jul 14, 2026. ## Community Health: - Overall community health is good. - Development and governance activity remained high during the reporting period. Apache Spark 4.2.0 addressed more than 1,700 JIRA tickets, with contributions from more than 250 individuals. - New contributors also continued to engage on the development mailing list and receive guidance from established contributors. No community health concerns were identified. - The project added four new committers (Szehon Ho, Yicong Huang, Tian Gao, and Uroš Bojanić), and one new PMC member (Peter Toth). - The project made 6 releases and voted to accept 6 major Spark Improvement Proposals (SPIPs), as described in the previous section. - Mailing list stats: - [email protected] had a 17% increase in traffic in the past quarter (635 emails compared to 539) - [email protected] had a 31% increase in traffic in the past quarter (9630 emails compared to 7306) - [email protected] had a 30% increase in traffic in the past quarter (16179 emails compared to 12438) - 1841 JIRA tickets opened and 1733 closed in the past quarter. ## Trademarks: - No changes since the last report. ==================================== --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
