Seng created AIRFLOW-4005:
-----------------------------

             Summary: Visualization of DAG dependences in the UI
                 Key: AIRFLOW-4005
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4005
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Seng
             Fix For: 2.0.0


Airflow allows to set up dependencies between DAGS for example by using 
TriggerDagRunOperator.

Airflow knows which DAG depends on which however this information is not 
visible to the user. 

Since DAGs can grow over time and some systems may contain 100+ DAGs it's very 
hard to keep track about DAG dependencies. If I need to make a change in DAG I 
have no way of knowing what will be the effect on other DAGs as it could be 
that the DAG i'm modifying now is being externally triggered from somewhere 
else. 

I suggest (if feasible) to  demonstrate the DAGs relations in the UI (very 
similar to showing Tasks dependencies) 

For this code:

[https://github.com/apache/airflow/blob/master/airflow/example_dags/example_trigger_controller_dag.py]

 

The UI will show:

example_trigger_controller_dag  ----->  example_trigger_target_dag

With this information if someone wants to edit the example_trigger_target_dag 
he can know that he must check the effect of this change on the 
example_trigger_controller_dag.

Note: this doesn't specify the nature of relation between the DAGs it just 
showing that there is a relation. It doesn't also have to show the relation 
between specific tasks inside the DAG (though this can be nice). 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to