Hello,

Our quarterly ASF board report is coming up.

I have prepared a draft document here[1] and copy pasted its current
contents below. The tracking ticket is at [2]

As always, we welcome any and all community input. Please provide your
feedback  by September 9, 2026, either by proposing changes in the google
doc, or by responding to this email

Andrew


[1]:
https://docs.google.com/document/d/14HB7XRQiNQe5ghxUThqW6rMSj5mDqkQkvXVpgCIYMP8
[2]: https://github.com/apache/datafusion/issues/22889


-------


## Description:
The mission of Apache DataFusion is the creation and maintenance of software
related to an extensible query engine

## Project Status:
Current project status: New + Ongoing (high activity)
Issues for the board: None

## Membership Data:

Apache DataFusion was founded 2024-04-16 (2 years ago)
There are currently 61 committers and 24 PMC members in this project.
The Committer-to-PMC ratio is roughly 8:3.

Community changes, past quarter:
- Matt Butrovich was added to the PMC on 2026-06-15
- Qi Zhu was added to the PMC on 2026-08-04
- Adam Gutglick was added as committer on 2026-07-20
- Manu Zhang was added as committer on 2026-08-20
- Neil Conway was added as committer on 2026-06-14

## Project Activity:
Note that almost all communication for DataFusion and its subprojects
happens
on github and so our dev mailing list traffic is fairly light.

### DataFusion core
https://github.com/apache/datafusion
55.0.0 was released on 2026-08-18.
54.1.0 was released on 2026-07-18.
54.0.0 was released on 2026-06-08.

Our releases now consist of contributions from over 170 distinct
contributors (was 120), and we average around [11.2 commits per day] to the
main repo (up from [9.2 commits per day])

[11.2 commits per day]: git rev-list --count apache/main
--since='2026-06-09 00:00:00' --until='2026-09-08 23:59:59' (measured
2026-08-27: 883 commits / 79 days)
[9.2 commits per day]: git rev-list --count apache/main --since='2026-03-10
00:00:00' --until='2026-06-08 23:59:59'

The community continues to write blogs highlighting our work, see
https://datafusion.apache.org/blog/

Likewise we continue to hold in person meetups as community members have
bandwidth to organize them, see:
https://datafusion.apache.org/user-guide/concepts-readings-events.html#community-events

We have been discussing the best process and setup to help maintain the
Apache Iceberg’s Rust Implementation’s DataFusion Integration. The
communities are working together to find a consensus solution. See the
[mailing list topic] for more details

[mailing list topic]:
https://lists.apache.org/thread/53lqjw7371myww42l19vx923cjzrgg68

### Sub project: DataFusion Python

https://github.com/apache/datafusion-python
DATAFUSION-PYTHON-54.0.0 was released on 2026-06-29.

[TODO: DataFusion Python highlights this quarter]

### Sub project: DataFusion Java

https://github.com/apache/datafusion-java

[TODO: DataFusion Java highlights this quarter (added as a subproject last
quarter)]

### Sub project: DataFusion Comet

https://github.com/apache/datafusion-comet
COMET-1.0.0 was released on 2026-08-07.
COMET-0.17.1 was released on 2026-07-17.
COMET-0.17.0 was released on 2026-06-20.

Comet reached its 1.0.0 milestone this quarter. You can read about the
recent happenings in Comet in the release blogs:
https://datafusion.apache.org/blog/2026/08/07/datafusion-comet-1.0.0
https://datafusion.apache.org/blog/2026/06/20/datafusion-comet-0.17.0

The community also published a post about their experience running Spark
workloads with Comet on Amazon EKS:
https://datafusion.apache.org/blog/2026/06/03/comet-eks

### Sub project: DataFusion Ballista

https://github.com/apache/datafusion-ballista
BALLISTA-54.1.0 was released on 2026-08-09.
BALLISTA-54.0.0 was released on 2026-07-15.

[TODO: Ballista highlights this quarter]

### Sub project: sqlparser-rs

https://github.com/apache/datafusion-sqlparser-rs

There were no new sqlparser-rs releases this quarter (SQLPARSER-0.62.0 was
released on 2026-05-27). We plan the next one in September 2026.

We are actively working to help Ifeanyi Ubah (iffyio), the primary
maintainer, to identify additional community members who can help maintain
the project.

## Community Health:

The rise of AI coding tools, and the popularity of DataFusion in the
ecosystem means we are moving code faster than ever before. Our code review
capacity is never enough, but we have many active committers, and the
community in general helps each other out with reviews. We continue to
actively grow our committer and PMC ranks and the future looks bright.

We continue to merge multiple PRs a day from multiple committers and
have contributions from a wide variety of individuals with a wide
variety of employers, organizations, and backgrounds. Recently, we have had
some bursts of spam PRs, where multiple PRs are opened by new contributors
in a short amount of time, with no follow up on any PR feedback. We have
been discussing if a new "Policy on uptick of LLM PRs from new
contributors" is warranted. See [24413] for more details

[24413]: https://github.com/apache/datafusion/discussions/24413

Reply via email to