Hello,

I would like to share with you a proposal for the implementation of a dag
"calendar view" in the Airflow UI, which is a feature that I find very
useful when managing dags with a large number of dag runs.


The aim is to provide visibility over the full state of the dag by
displaying the aggregated dag runs' states in a calendar.

Each day is displayed with a color according to the dag runs' states for
that day:

- If at least one dag run has failed for a day, that day will be displayed
as "failed".

- If all dag runs have succeeded the day will be shown as "succeeded".

- If there are still running dag runs (and no failed dag run) for that day,
the day will be shown as "running".

Clicking on a day redirects to the tree view for that day.


This makes it possible to monitor the state of thousands of dag runs in a
single view that is concise and easy to understand. It is particularly
useful to monitor the state of large backfills.


You may find screenshots, as well as additional details, in the following
Google doc:
https://docs.google.com/document/d/1fayWWbia7r1iPuHL23JeKJCP5JcKdOlHpLzrdAH0nT4/edit?usp=sharing
.

A prototype implementation is available at
https://github.com/BenoitHanotte/airflow/pull/2/files.


I'd gladly get your feedback on the idea, and on whether it is worth moving
forward by creating an AIP to formalize this proposal.


Thank you!


Benoit Hanotte

Reply via email to