Seng created AIRFLOW-4005:
-----------------------------
Summary: Visualization of DAG dependences in the UI
Key: AIRFLOW-4005
URL: https://issues.apache.org/jira/browse/AIRFLOW-4005
Project: Apache Airflow
Issue Type: Improvement
Reporter: Seng
Fix For: 2.0.0
Airflow allows to set up dependencies between DAGS for example by using
TriggerDagRunOperator.
Airflow knows which DAG depends on which however this information is not
visible to the user.
Since DAGs can grow over time and some systems may contain 100+ DAGs it's very
hard to keep track about DAG dependencies. If I need to make a change in DAG I
have no way of knowing what will be the effect on other DAGs as it could be
that the DAG i'm modifying now is being externally triggered from somewhere
else.
I suggest (if feasible) to demonstrate the DAGs relations in the UI (very
similar to showing Tasks dependencies)
For this code:
[https://github.com/apache/airflow/blob/master/airflow/example_dags/example_trigger_controller_dag.py]
The UI will show:
example_trigger_controller_dag -----> example_trigger_target_dag
With this information if someone wants to edit the example_trigger_target_dag
he can know that he must check the effect of this change on the
example_trigger_controller_dag.
Note: this doesn't specify the nature of relation between the DAGs it just
showing that there is a relation. It doesn't also have to show the relation
between specific tasks inside the DAG (though this can be nice).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)