vividbaek opened a new pull request, #74073:
URL: https://github.com/apache/airflow/pull/74073
The architecture diagrams in `core-concepts/overview.rst` and several other
pages still describe the
Airflow 2 layout, where the scheduler parses Dag files and workers talk to
the metadata database
directly. In Airflow 3 the Dag processor is required, the scheduler never
accesses Dag bundles, and
workers reach the database only through the API server's Execution API, as
the overview text right
above the diagrams already says.
- Regenerate the basic, distributed and Dag processor diagrams: add the Dag
processor where it was
missing, sync Dag bundles only to the Dag processor and workers, replace
direct worker-to-DB edges
with Execution API edges to the API server, and use "Dag bundle" / "Dag"
labels.
- Add a legend entry for the new Execution API edges and remove the AIP-72
TODO.
- Say "Dag processor" instead of "scheduler" where the docs describe parsing
Dag files
(best practices, Dags concepts, modules management).
| | Before | After |
|---|---|---|
| Basic | <img width="1560" height="943" alt="before_basic"
src="https://github.com/user-attachments/assets/396fb5fa-6264-43af-be0c-4f97cae54504";
/> | <img width="1560" height="1117" alt="after_basic"
src="https://github.com/user-attachments/assets/f4028e4f-0238-4de2-977a-604db77ddae6";
/> |
| Distributed | <img width="2367" height="1376" alt="before_distributed"
src="https://github.com/user-attachments/assets/c995cda2-51db-4e1e-b664-2dcbee285fa7";
/> | <img width="2239" height="1630" alt="after_distributed"
src="https://github.com/user-attachments/assets/eb9f9ee5-7ecb-42a0-a007-62e4f7beff9d";
/> |
| Dag processor | <img width="2308" height="1455" alt="before_dag_processor"
src="https://github.com/user-attachments/assets/7fd912ca-50ad-4dc0-8724-aa5ce39caaf1";
/> | <img width="2303" height="1428" alt="after_dag_processor"
src="https://github.com/user-attachments/assets/05f9970b-ec87-4990-adb5-028be9815fbb";
/> |
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes — Claude Code (Opus 5.5)
Generated-by: Claude Code (Opus 5.5) following [the
guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
