[ 
https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013523#comment-17013523
 ] 

ASF GitHub Bot commented on AIRFLOW-2279:
-----------------------------------------

yuqian90 commented on pull request #7139: [AIRFLOW-2279] Clear tasks across 
DAGs if marked by ExternalTaskMarker
URL: https://github.com/apache/airflow/pull/7139
 
 
   This change was already merged into master. I'm creating this PR to help 
committers merge into v1-10-test.
   
   ---
   Issue link: WILL BE INSERTED BY 
[boring-cyborg](https://github.com/kaxil/boring-cyborg)
   
   - [ ] Description above provides context of the change
   - [ ] Commit message/PR title starts with `[AIRFLOW-NNNN]`. AIRFLOW-NNNN = 
JIRA ID<sup>*</sup>
   - [ ] Unit tests coverage for changes (not needed for documentation changes)
   - [ ] Commits follow "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)"
   - [ ] Relevant documentation is updated including usage instructions.
   - [ ] I will engage committers as explained in [Contribution Workflow 
Example](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#contribution-workflow-example).
   
   <sup>*</sup> For document-only changes commit message can start with 
`[AIRFLOW-XXXX]`.
   
   ---
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md).
   Read the [Pull Request 
Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)
 for more information.
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


> Clearing Tasks Across DAGs
> --------------------------
>
>                 Key: AIRFLOW-2279
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2279
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Achal Soni
>            Assignee: Qian Yu
>            Priority: Major
>             Fix For: 2.0.0
>
>         Attachments: cross_dag_ui_screenshot.png
>
>
> At Stripe, we commonly have discrete dags that depend on each other by 
> leveraging ExternalTaskSensors. We also find ourselves routinely wanting to 
> not only clear tasks and their downstream tasks in a particular dag, but also 
> their downstream tasks in their dependent dags (linked by 
> ExternalTaskSensors). 
> We currently have extended Airflow to handle this by modifying the webapp and 
> cli tool to optionally clear dependent tasks across multiple dags (see 
> attached screenshot). 
> We want to open the floor for discussion with the larger Airflow community 
> about the usage of ExternalTaskSensors and specifically how to handle 
> clearing across dags. We are interested in learning more about the accepted 
> practices in this regard, and are very open/willing to contribute in this 
> area if there is interest!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to