[
https://issues.apache.org/jira/browse/AIRFLOW-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kiran Pathak resolved AIRFLOW-3902.
-----------------------------------
Resolution: Done
PR reviewed by two contributors but waiting on committers' review.
> Singleton operator to skip downstream tasks
> -------------------------------------------
>
> Key: AIRFLOW-3902
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3902
> Project: Apache Airflow
> Issue Type: New Feature
> Components: operators
> Reporter: Kiran Pathak
> Assignee: Kiran Pathak
> Priority: Major
> Labels: operator, singleton
> Attachments: image-2019-02-18-05-03-00-290.png,
> image-2019-02-18-05-03-58-662.png
>
>
> This operator will:
> * check for downstream tasks from previous DagRuns in *_unfinished_* state
> * skip downstream tasks from execution if it finds a downstream task in
> running state from previous DagRuns
> This feature ensures downstream children of this operator only one instance
> is scheduled to run. It avoids unnecessary processing / scheduling if it does
> not need to.
> !image-2019-02-18-05-03-00-290.png|width=213,height=102!
> !image-2019-02-18-05-03-58-662.png|width=224,height=88!
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
