[ 
https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012376#comment-17012376
 ] 

ASF subversion and git services commented on AIRFLOW-2279:
----------------------------------------------------------

Commit d7499b11d2bb2dc78dcee4b02c6388dfea6a2c3a in airflow's branch 
refs/heads/master from yuqian90
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=d7499b1 ]

[AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker (#6633)



> Clearing Tasks Across DAGs
> --------------------------
>
>                 Key: AIRFLOW-2279
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2279
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Achal Soni
>            Assignee: Qian Yu
>            Priority: Major
>         Attachments: cross_dag_ui_screenshot.png
>
>
> At Stripe, we commonly have discrete dags that depend on each other by 
> leveraging ExternalTaskSensors. We also find ourselves routinely wanting to 
> not only clear tasks and their downstream tasks in a particular dag, but also 
> their downstream tasks in their dependent dags (linked by 
> ExternalTaskSensors). 
> We currently have extended Airflow to handle this by modifying the webapp and 
> cli tool to optionally clear dependent tasks across multiple dags (see 
> attached screenshot). 
> We want to open the floor for discussion with the larger Airflow community 
> about the usage of ExternalTaskSensors and specifically how to handle 
> clearing across dags. We are interested in learning more about the accepted 
> practices in this regard, and are very open/willing to contribute in this 
> area if there is interest!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to