This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v3-0-test in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 14e601dc016fe853f81fc61cb4997bdee893b74f Author: Jens Scheffler <[email protected]> AuthorDate: Mon Apr 21 23:19:02 2025 +0200 Update screenshots for Airflow 3 UI overview (#49518) * Update screenshots for Airflow 3 UI overview * Filename-typo (cherry picked from commit e9571fa158066e307d7f3f59beb388a82c991e7f) --- README.md | 16 ++- airflow-core/docs/core-concepts/overview.rst | 2 +- airflow-core/docs/core-concepts/params.rst | 8 +- airflow-core/docs/img/assets.png | Bin 305545 -> 0 bytes airflow-core/docs/img/audit_log.png | Bin 456601 -> 0 bytes airflow-core/docs/img/backfill.png | Bin 481589 -> 0 bytes airflow-core/docs/img/cluster_activity.png | Bin 116167 -> 0 bytes airflow-core/docs/img/code.png | Bin 829390 -> 0 bytes airflow-core/docs/img/dags.png | Bin 418739 -> 0 bytes airflow-core/docs/img/duration.png | Bin 358076 -> 0 bytes airflow-core/docs/img/gantt.png | Bin 313750 -> 0 bytes airflow-core/docs/img/graph.png | Bin 567178 -> 0 bytes airflow-core/docs/img/grid.png | Bin 628939 -> 0 bytes airflow-core/docs/img/grid_instance_details.png | Bin 178129 -> 0 bytes airflow-core/docs/img/grid_mapped_task.png | Bin 135753 -> 0 bytes airflow-core/docs/img/grid_run_details.png | Bin 202106 -> 0 bytes airflow-core/docs/img/grid_task_details.png | Bin 227349 -> 0 bytes airflow-core/docs/img/grid_task_group.png | Bin 56287 -> 0 bytes airflow-core/docs/img/home.png | Bin 465823 -> 0 bytes airflow-core/docs/img/run_types.png | Bin 5950 -> 0 bytes airflow-core/docs/img/ui-dark/assets.png | Bin 0 -> 124074 bytes airflow-core/docs/img/ui-dark/assets_graph.png | Bin 0 -> 140135 bytes airflow-core/docs/img/ui-dark/backfill.png | Bin 0 -> 97497 bytes airflow-core/docs/img/ui-dark/code.png | Bin 0 -> 227593 bytes airflow-core/docs/img/ui-dark/dags.png | Bin 0 -> 117751 bytes airflow-core/docs/img/ui-dark/events.png | Bin 0 -> 169550 bytes airflow-core/docs/img/ui-dark/graph.png | Bin 0 -> 199214 bytes .../docs/img/ui-dark/graph_dependencies.png | Bin 0 -> 164162 bytes airflow-core/docs/img/ui-dark/grid.png | Bin 0 -> 190998 bytes .../docs/img/ui-dark/grid_instance_details.png | Bin 0 -> 199655 bytes airflow-core/docs/img/ui-dark/grid_mapped_task.png | Bin 0 -> 119927 bytes airflow-core/docs/img/ui-dark/grid_run_details.png | Bin 0 -> 197172 bytes .../docs/img/ui-dark/grid_task_details.png | Bin 0 -> 167298 bytes airflow-core/docs/img/ui-dark/grid_task_group.png | Bin 0 -> 18439 bytes airflow-core/docs/img/ui-dark/home.png | Bin 0 -> 115184 bytes airflow-core/docs/img/ui-dark/run_types.png | Bin 0 -> 17103 bytes .../img/ui-dark/trigger-dag-tutorial-form-1.png | Bin 0 -> 66312 bytes .../img/ui-dark/trigger-dag-tutorial-form-2.png | Bin 0 -> 116706 bytes .../img/ui-dark/trigger-dag-tutorial-form-3.png | Bin 0 -> 80046 bytes .../img/ui-dark/trigger-dag-tutorial-form-4.png | Bin 0 -> 99544 bytes airflow-core/docs/img/ui-light/assets.png | Bin 0 -> 121058 bytes airflow-core/docs/img/ui-light/assets_graph.png | Bin 0 -> 140281 bytes airflow-core/docs/img/ui-light/backfill.png | Bin 0 -> 99130 bytes airflow-core/docs/img/ui-light/code.png | Bin 0 -> 209734 bytes airflow-core/docs/img/ui-light/dags.png | Bin 0 -> 116182 bytes airflow-core/docs/img/ui-light/events.png | Bin 0 -> 169914 bytes airflow-core/docs/img/ui-light/graph.png | Bin 0 -> 202053 bytes .../docs/img/ui-light/graph_dependencies.png | Bin 0 -> 166496 bytes airflow-core/docs/img/ui-light/grid.png | Bin 0 -> 191456 bytes .../docs/img/ui-light/grid_instance_details.png | Bin 0 -> 199600 bytes .../docs/img/ui-light/grid_mapped_task.png | Bin 0 -> 119568 bytes .../docs/img/ui-light/grid_run_details.png | Bin 0 -> 197229 bytes .../docs/img/ui-light/grid_task_details.png | Bin 0 -> 167072 bytes airflow-core/docs/img/ui-light/grid_task_group.png | Bin 0 -> 18666 bytes airflow-core/docs/img/ui-light/home.png | Bin 0 -> 114761 bytes airflow-core/docs/img/ui-light/run_types.png | Bin 0 -> 21343 bytes .../{ => ui-light}/trigger-dag-tutorial-form-1.png | Bin .../{ => ui-light}/trigger-dag-tutorial-form-2.png | Bin .../{ => ui-light}/trigger-dag-tutorial-form-3.png | Bin .../{ => ui-light}/trigger-dag-tutorial-form-4.png | Bin airflow-core/docs/ui.rst | 144 +++++++++------------ 61 files changed, 75 insertions(+), 95 deletions(-) diff --git a/README.md b/README.md index 5acb69838ad..95c5c367050 100644 --- a/README.md +++ b/README.md @@ -230,27 +230,31 @@ following the ASF Policy. - **DAGs**: Overview of all DAGs in your environment. -  +  + +- **Assets**: Overview of Assets with dependencies. + +  - **Grid**: Grid representation of a DAG that spans across time. -  +  - **Graph**: Visualization of a DAG's dependencies and their current status for a specific run. -  +  - **Home**: Summary statistics of your Airflow environment. -  +  - **Backfill**: Backfilling a DAG for a specific date range. -  +  - **Code**: Quick way to view source code of a DAG. -  +  ## Semantic versioning diff --git a/airflow-core/docs/core-concepts/overview.rst b/airflow-core/docs/core-concepts/overview.rst index a0111b59183..c929c3da725 100644 --- a/airflow-core/docs/core-concepts/overview.rst +++ b/airflow-core/docs/core-concepts/overview.rst @@ -243,6 +243,6 @@ User interface Airflow comes with a user interface that lets you see what dags and their tasks are doing, trigger runs of dags, view logs, and do some limited debugging and resolution of problems with your dags. -.. image:: ../img/dags.png +.. image:: ../img/ui-dark/dags.png It's generally the best way to see the status of your Airflow installation as a whole, as well as diving into individual dags to see their layout, the status of each task, and the logs from each task. diff --git a/airflow-core/docs/core-concepts/params.rst b/airflow-core/docs/core-concepts/params.rst index dd655cae2a3..805da212d35 100644 --- a/airflow-core/docs/core-concepts/params.rst +++ b/airflow-core/docs/core-concepts/params.rst @@ -386,19 +386,19 @@ For examples, please take a look at the two example dags provided: :ref:`Params The Params UI Tutorial is rendered in 4 sections with the most common examples. The first section shows the basic usage without ``Param`` class. -.. image:: ../img/trigger-dag-tutorial-form-1.png +.. image:: ../img/ui-dark/trigger-dag-tutorial-form-1.png The second section shows how to use the ``Param`` class to define more attributes. -.. image:: ../img/trigger-dag-tutorial-form-2.png +.. image:: ../img/ui-dark/trigger-dag-tutorial-form-2.png The third section shows how to model selection lists and drop-downs. -.. image:: ../img/trigger-dag-tutorial-form-3.png +.. image:: ../img/ui-dark/trigger-dag-tutorial-form-3.png Finally the fourth section shows advanced form elements. -.. image:: ../img/trigger-dag-tutorial-form-4.png +.. image:: ../img/ui-dark/trigger-dag-tutorial-form-4.png .. versionchanged:: 3.0.0 By default custom HTML is not allowed to prevent injection of scripts or other malicious HTML code. The previous field named diff --git a/airflow-core/docs/img/assets.png b/airflow-core/docs/img/assets.png deleted file mode 100644 index 990e3f0c15c..00000000000 Binary files a/airflow-core/docs/img/assets.png and /dev/null differ diff --git a/airflow-core/docs/img/audit_log.png b/airflow-core/docs/img/audit_log.png deleted file mode 100644 index 062fbaa533e..00000000000 Binary files a/airflow-core/docs/img/audit_log.png and /dev/null differ diff --git a/airflow-core/docs/img/backfill.png b/airflow-core/docs/img/backfill.png deleted file mode 100644 index 2abab8235d1..00000000000 Binary files a/airflow-core/docs/img/backfill.png and /dev/null differ diff --git a/airflow-core/docs/img/cluster_activity.png b/airflow-core/docs/img/cluster_activity.png deleted file mode 100644 index 7263d07d854..00000000000 Binary files a/airflow-core/docs/img/cluster_activity.png and /dev/null differ diff --git a/airflow-core/docs/img/code.png b/airflow-core/docs/img/code.png deleted file mode 100644 index a9e2867469a..00000000000 Binary files a/airflow-core/docs/img/code.png and /dev/null differ diff --git a/airflow-core/docs/img/dags.png b/airflow-core/docs/img/dags.png deleted file mode 100644 index 457dad04f9c..00000000000 Binary files a/airflow-core/docs/img/dags.png and /dev/null differ diff --git a/airflow-core/docs/img/duration.png b/airflow-core/docs/img/duration.png deleted file mode 100644 index 3f552b847a0..00000000000 Binary files a/airflow-core/docs/img/duration.png and /dev/null differ diff --git a/airflow-core/docs/img/gantt.png b/airflow-core/docs/img/gantt.png deleted file mode 100644 index 0a8afceeb21..00000000000 Binary files a/airflow-core/docs/img/gantt.png and /dev/null differ diff --git a/airflow-core/docs/img/graph.png b/airflow-core/docs/img/graph.png deleted file mode 100644 index cbb17ca3adf..00000000000 Binary files a/airflow-core/docs/img/graph.png and /dev/null differ diff --git a/airflow-core/docs/img/grid.png b/airflow-core/docs/img/grid.png deleted file mode 100644 index 8ac6f458c28..00000000000 Binary files a/airflow-core/docs/img/grid.png and /dev/null differ diff --git a/airflow-core/docs/img/grid_instance_details.png b/airflow-core/docs/img/grid_instance_details.png deleted file mode 100644 index 8e8888654de..00000000000 Binary files a/airflow-core/docs/img/grid_instance_details.png and /dev/null differ diff --git a/airflow-core/docs/img/grid_mapped_task.png b/airflow-core/docs/img/grid_mapped_task.png deleted file mode 100644 index 7e64923c8f5..00000000000 Binary files a/airflow-core/docs/img/grid_mapped_task.png and /dev/null differ diff --git a/airflow-core/docs/img/grid_run_details.png b/airflow-core/docs/img/grid_run_details.png deleted file mode 100644 index 68de1820a49..00000000000 Binary files a/airflow-core/docs/img/grid_run_details.png and /dev/null differ diff --git a/airflow-core/docs/img/grid_task_details.png b/airflow-core/docs/img/grid_task_details.png deleted file mode 100644 index 62d3f859e78..00000000000 Binary files a/airflow-core/docs/img/grid_task_details.png and /dev/null differ diff --git a/airflow-core/docs/img/grid_task_group.png b/airflow-core/docs/img/grid_task_group.png deleted file mode 100644 index b69656582f5..00000000000 Binary files a/airflow-core/docs/img/grid_task_group.png and /dev/null differ diff --git a/airflow-core/docs/img/home.png b/airflow-core/docs/img/home.png deleted file mode 100644 index fa0b30c636b..00000000000 Binary files a/airflow-core/docs/img/home.png and /dev/null differ diff --git a/airflow-core/docs/img/run_types.png b/airflow-core/docs/img/run_types.png deleted file mode 100644 index 6025508e8cc..00000000000 Binary files a/airflow-core/docs/img/run_types.png and /dev/null differ diff --git a/airflow-core/docs/img/ui-dark/assets.png b/airflow-core/docs/img/ui-dark/assets.png new file mode 100644 index 00000000000..14b3c19c17c Binary files /dev/null and b/airflow-core/docs/img/ui-dark/assets.png differ diff --git a/airflow-core/docs/img/ui-dark/assets_graph.png b/airflow-core/docs/img/ui-dark/assets_graph.png new file mode 100644 index 00000000000..5250eb4f388 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/assets_graph.png differ diff --git a/airflow-core/docs/img/ui-dark/backfill.png b/airflow-core/docs/img/ui-dark/backfill.png new file mode 100644 index 00000000000..e84ea82c259 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/backfill.png differ diff --git a/airflow-core/docs/img/ui-dark/code.png b/airflow-core/docs/img/ui-dark/code.png new file mode 100644 index 00000000000..58ab7bb78a8 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/code.png differ diff --git a/airflow-core/docs/img/ui-dark/dags.png b/airflow-core/docs/img/ui-dark/dags.png new file mode 100644 index 00000000000..56458caedef Binary files /dev/null and b/airflow-core/docs/img/ui-dark/dags.png differ diff --git a/airflow-core/docs/img/ui-dark/events.png b/airflow-core/docs/img/ui-dark/events.png new file mode 100644 index 00000000000..3dbcfcdcbc8 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/events.png differ diff --git a/airflow-core/docs/img/ui-dark/graph.png b/airflow-core/docs/img/ui-dark/graph.png new file mode 100644 index 00000000000..3679c7bad47 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/graph.png differ diff --git a/airflow-core/docs/img/ui-dark/graph_dependencies.png b/airflow-core/docs/img/ui-dark/graph_dependencies.png new file mode 100644 index 00000000000..ff9f681e5c3 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/graph_dependencies.png differ diff --git a/airflow-core/docs/img/ui-dark/grid.png b/airflow-core/docs/img/ui-dark/grid.png new file mode 100644 index 00000000000..6e81f7d968a Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid.png differ diff --git a/airflow-core/docs/img/ui-dark/grid_instance_details.png b/airflow-core/docs/img/ui-dark/grid_instance_details.png new file mode 100644 index 00000000000..bad26eebf46 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid_instance_details.png differ diff --git a/airflow-core/docs/img/ui-dark/grid_mapped_task.png b/airflow-core/docs/img/ui-dark/grid_mapped_task.png new file mode 100644 index 00000000000..fce5369f4a2 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid_mapped_task.png differ diff --git a/airflow-core/docs/img/ui-dark/grid_run_details.png b/airflow-core/docs/img/ui-dark/grid_run_details.png new file mode 100644 index 00000000000..47aa122c011 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid_run_details.png differ diff --git a/airflow-core/docs/img/ui-dark/grid_task_details.png b/airflow-core/docs/img/ui-dark/grid_task_details.png new file mode 100644 index 00000000000..f79a0ed2227 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid_task_details.png differ diff --git a/airflow-core/docs/img/ui-dark/grid_task_group.png b/airflow-core/docs/img/ui-dark/grid_task_group.png new file mode 100644 index 00000000000..e22e632853e Binary files /dev/null and b/airflow-core/docs/img/ui-dark/grid_task_group.png differ diff --git a/airflow-core/docs/img/ui-dark/home.png b/airflow-core/docs/img/ui-dark/home.png new file mode 100644 index 00000000000..deb203d4ba3 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/home.png differ diff --git a/airflow-core/docs/img/ui-dark/run_types.png b/airflow-core/docs/img/ui-dark/run_types.png new file mode 100644 index 00000000000..5816513b5d6 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/run_types.png differ diff --git a/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-1.png b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-1.png new file mode 100644 index 00000000000..abc253fa94c Binary files /dev/null and b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-1.png differ diff --git a/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-2.png b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-2.png new file mode 100644 index 00000000000..c7551ff1421 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-2.png differ diff --git a/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-3.png b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-3.png new file mode 100644 index 00000000000..9c6c33ce9c2 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-3.png differ diff --git a/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-4.png b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-4.png new file mode 100644 index 00000000000..f415de98148 Binary files /dev/null and b/airflow-core/docs/img/ui-dark/trigger-dag-tutorial-form-4.png differ diff --git a/airflow-core/docs/img/ui-light/assets.png b/airflow-core/docs/img/ui-light/assets.png new file mode 100644 index 00000000000..23bec52c0e4 Binary files /dev/null and b/airflow-core/docs/img/ui-light/assets.png differ diff --git a/airflow-core/docs/img/ui-light/assets_graph.png b/airflow-core/docs/img/ui-light/assets_graph.png new file mode 100644 index 00000000000..7e1c711a70e Binary files /dev/null and b/airflow-core/docs/img/ui-light/assets_graph.png differ diff --git a/airflow-core/docs/img/ui-light/backfill.png b/airflow-core/docs/img/ui-light/backfill.png new file mode 100644 index 00000000000..5576d7948f4 Binary files /dev/null and b/airflow-core/docs/img/ui-light/backfill.png differ diff --git a/airflow-core/docs/img/ui-light/code.png b/airflow-core/docs/img/ui-light/code.png new file mode 100644 index 00000000000..36c0cfb7976 Binary files /dev/null and b/airflow-core/docs/img/ui-light/code.png differ diff --git a/airflow-core/docs/img/ui-light/dags.png b/airflow-core/docs/img/ui-light/dags.png new file mode 100644 index 00000000000..0c408515fb1 Binary files /dev/null and b/airflow-core/docs/img/ui-light/dags.png differ diff --git a/airflow-core/docs/img/ui-light/events.png b/airflow-core/docs/img/ui-light/events.png new file mode 100644 index 00000000000..d27ea0366ed Binary files /dev/null and b/airflow-core/docs/img/ui-light/events.png differ diff --git a/airflow-core/docs/img/ui-light/graph.png b/airflow-core/docs/img/ui-light/graph.png new file mode 100644 index 00000000000..daca11ce001 Binary files /dev/null and b/airflow-core/docs/img/ui-light/graph.png differ diff --git a/airflow-core/docs/img/ui-light/graph_dependencies.png b/airflow-core/docs/img/ui-light/graph_dependencies.png new file mode 100644 index 00000000000..8253dfdc613 Binary files /dev/null and b/airflow-core/docs/img/ui-light/graph_dependencies.png differ diff --git a/airflow-core/docs/img/ui-light/grid.png b/airflow-core/docs/img/ui-light/grid.png new file mode 100644 index 00000000000..e0770a5eff0 Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid.png differ diff --git a/airflow-core/docs/img/ui-light/grid_instance_details.png b/airflow-core/docs/img/ui-light/grid_instance_details.png new file mode 100644 index 00000000000..ebe9a1011c4 Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid_instance_details.png differ diff --git a/airflow-core/docs/img/ui-light/grid_mapped_task.png b/airflow-core/docs/img/ui-light/grid_mapped_task.png new file mode 100644 index 00000000000..0ec788086ba Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid_mapped_task.png differ diff --git a/airflow-core/docs/img/ui-light/grid_run_details.png b/airflow-core/docs/img/ui-light/grid_run_details.png new file mode 100644 index 00000000000..9bf6542888c Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid_run_details.png differ diff --git a/airflow-core/docs/img/ui-light/grid_task_details.png b/airflow-core/docs/img/ui-light/grid_task_details.png new file mode 100644 index 00000000000..38c8ed66ef1 Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid_task_details.png differ diff --git a/airflow-core/docs/img/ui-light/grid_task_group.png b/airflow-core/docs/img/ui-light/grid_task_group.png new file mode 100644 index 00000000000..ae59f732da4 Binary files /dev/null and b/airflow-core/docs/img/ui-light/grid_task_group.png differ diff --git a/airflow-core/docs/img/ui-light/home.png b/airflow-core/docs/img/ui-light/home.png new file mode 100644 index 00000000000..49d215825a8 Binary files /dev/null and b/airflow-core/docs/img/ui-light/home.png differ diff --git a/airflow-core/docs/img/ui-light/run_types.png b/airflow-core/docs/img/ui-light/run_types.png new file mode 100644 index 00000000000..5e97757c9df Binary files /dev/null and b/airflow-core/docs/img/ui-light/run_types.png differ diff --git a/airflow-core/docs/img/trigger-dag-tutorial-form-1.png b/airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-1.png similarity index 100% rename from airflow-core/docs/img/trigger-dag-tutorial-form-1.png rename to airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-1.png diff --git a/airflow-core/docs/img/trigger-dag-tutorial-form-2.png b/airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-2.png similarity index 100% rename from airflow-core/docs/img/trigger-dag-tutorial-form-2.png rename to airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-2.png diff --git a/airflow-core/docs/img/trigger-dag-tutorial-form-3.png b/airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-3.png similarity index 100% rename from airflow-core/docs/img/trigger-dag-tutorial-form-3.png rename to airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-3.png diff --git a/airflow-core/docs/img/trigger-dag-tutorial-form-4.png b/airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-4.png similarity index 100% rename from airflow-core/docs/img/trigger-dag-tutorial-form-4.png rename to airflow-core/docs/img/ui-light/trigger-dag-tutorial-form-4.png diff --git a/airflow-core/docs/ui.rst b/airflow-core/docs/ui.rst index cfdb210b499..b6984c7c5f5 100644 --- a/airflow-core/docs/ui.rst +++ b/airflow-core/docs/ui.rst @@ -24,6 +24,20 @@ Here's a quick overview of some of the features and visualizations you can find in the Airflow UI. +.. _ui:home: + +Home Page +......... + +Gives an overview about recent running dags and tasks and basic system health. + +------------ + +.. image:: img/ui-dark/home.png + +------------ + + Dags View ......... @@ -42,37 +56,27 @@ For example: ------------ -.. image:: img/dags.png +.. image:: img/ui-dark/dags.png ------------ -.. _ui:cluster-activity-view: - -Cluster Activity View -..................... +.. _ui:assets-view: -Native Airflow dashboard page into the UI to collect several useful metrics for monitoring your Airflow cluster. +Asset View +.......... ------------- +A combined listing of the current assets and details how they are produced and consumed by dags. -.. image:: img/cluster_activity.png +Clicking on any asset detail in the list will show it and its relationships, and filter the list to show the recent history of task instances that have updated that dataset and whether it has triggered further DAG runs. ------------ - -.. _ui:assets-view: - -Asset View -............. - -A combined listing of the current assets and a graph illustrating how they are produced and consumed by dags. - -Clicking on any dataset in either the list or the graph will highlight it and its relationships, and filter the list to show the recent history of task instances that have updated that dataset and whether it has triggered further DAG runs. +.. image:: img/ui-dark/assets.png ------------ -.. image:: img/assets.png +.. image:: img/ui-dark/assets_graph.png ------------ @@ -86,36 +90,46 @@ and below, task instances. If a pipeline is late, you can quickly see where the different steps are and identify the blocking ones. +The overview panel on the right provides fast access to recently failed tasks and logs. + +The overview includes the Dag runtime for the last execution to find outliers. + ------------ -.. image:: img/grid.png +.. image:: img/ui-dark/grid.png ------------ The details panel will update when selecting a DAG Run by clicking on a duration bar: -.. image:: img/grid_run_details.png +.. image:: img/ui-dark/grid_run_details.png Or selecting a Task Instance by clicking on a status box: -.. image:: img/grid_instance_details.png +.. image:: img/ui-dark/grid_instance_details.png -Or selecting a Task across all runs by click on the task_id: +Or selecting a Task across all runs by click on the task_id. -.. image:: img/grid_task_details.png +This also plots the duration of your different tasks over the past N runs. This view lets +you find outliers and quickly understand where the time is spent in your +DAG over many runs. + +.. image:: img/ui-dark/grid_task_details.png Manual runs are indicated by a play icon (just like the Trigger DAG button). -Asset triggered runs are indicated by a database icon: +Asset triggered runs are indicated by a database icon. +Normal scheduled runs have no indicator. +If a backfill was used to create the DAG run, it will be indicated by a arrow icon: -.. image:: img/run_types.png +.. image:: img/ui-dark/run_types.png Task groups are indicated by a caret and can be opened or closed: -.. image:: img/grid_task_group.png +.. image:: img/ui-dark/grid_task_group.png Mapped Tasks are indicated by square brackets and will show a table of each mapped task instance in the Mapped Tasks panel: -.. image:: img/grid_mapped_task.png +.. image:: img/ui-dark/grid_mapped_task.png ------------ @@ -130,19 +144,15 @@ dependencies and their current status for a specific run. ------------ -.. image:: img/graph.png +.. image:: img/ui-dark/graph.png ------------ -Calendar View -............. - -The calendar view gives you an overview of your entire DAG's history over months or even years. -Letting you quickly see trends of the overall success/failure rate of runs over time. +If you use the options to display external dependencies, you can follow asset conditions and events. ------------ -.. image:: img/calendar.png +.. image:: img/ui-dark/graph_dependencies.png ------------ @@ -160,49 +170,6 @@ by default, but can be configured to show in cleartext. See :ref:`security:mask- ------------ -Gantt Chart -........... - -The Gantt chart lets you analyse task duration and overlap. You can quickly -identify bottlenecks and where the bulk of the time is spent for specific -DAG runs. - ------------- - -.. image:: img/gantt.png - ------------- - -.. _ui:task-duration: - -Task Duration -............. - -The duration of your different tasks over the past N runs. This view lets -you find outliers and quickly understand where the time is spent in your -DAG over many runs. - - ------------- - -.. image:: img/duration.png - ------------- - -.. _ui:landing-times: - -Landing Times -............. - -The landing time for a task instance is the delta between the dag run's data interval end -(typically this means when the dag "should" run) and the dag run completion time. - ------------- - -.. image:: img/landing_times.png - ------------- - Code View ......... @@ -212,7 +179,17 @@ provide yet more context. ------------ -.. image:: img/code.png +.. image:: img/ui-dark/code.png + +Backfill +........ + +If runs in your scheduled Dag are missing you can use the backfill option in the UI to re-run missing +executions for a selective time interval. + +------------ + +.. image:: img/ui-dark/backfill.png Trigger Form ............ @@ -222,16 +199,15 @@ The form display is based on the DAG Parameters as described in :doc:`core-conce ------------ -.. image:: img/trigger-dag-tutorial-form-1.png +.. image:: img/ui-dark/trigger-dag-tutorial-form-1.png -Audit Log -............. +Events +...... -See all events related to a DAG. Filter events by changing the Task and DAG Run -selection and by including/excluding different event names. +See all events related to a DAG. ------------ -.. image:: img/audit_log.png +.. image:: img/ui-dark/events.png ------------
