[
https://issues.apache.org/jira/browse/AIRFLOW-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaodong DENG updated AIRFLOW-2843:
-----------------------------------
Description:
h2. Background
*ExternalTaskSensor* will keep waiting (given restrictions of retries,
poke_interval, etc), even if the external DAG/task specified doesn't exist at
all. In some cases, this waiting may still make sense as new DAG may backfill.
But it may be good to provide an option to cease waiting immediately if the
external DAG/task specified doesn't exist.
h2. Proposal
Provide an argument "check_existence". Set to *True* to check if the external
DAG/task exists, and immediately cease waiting if the external DAG/task does
not exist.
The default value is set to *False* (no check or ceasing will happen) so it
will not affect any existing DAGs or user expectation.
was:
h2. Background
*ExternalTaskSensor* will keep waiting (given restrictions of retries,
poke_interval, etc), even if the external task specified doesn't exist at all.
In some cases, this waiting may still make sense as new DAG may backfill.
But it may be good to provide an option to cease waiting immediately if the
external task specified doesn't exist.
h2. Proposal
Provide an argument "check_existence". Set to *True* to check if the external
task exists, and immediately cease waiting if the external task does not exist.
The default value is set to *False* (no check or ceasing will happen) so it
will not affect any existing DAGs or user expectation.
> ExternalTaskSensor: Add option to cease waiting immediately if the external
> DAG/task doesn't exist
> --------------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-2843
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2843
> Project: Apache Airflow
> Issue Type: Improvement
> Components: operators
> Reporter: Xiaodong DENG
> Assignee: Xiaodong DENG
> Priority: Minor
>
> h2. Background
> *ExternalTaskSensor* will keep waiting (given restrictions of retries,
> poke_interval, etc), even if the external DAG/task specified doesn't exist at
> all. In some cases, this waiting may still make sense as new DAG may backfill.
> But it may be good to provide an option to cease waiting immediately if the
> external DAG/task specified doesn't exist.
> h2. Proposal
> Provide an argument "check_existence". Set to *True* to check if the external
> DAG/task exists, and immediately cease waiting if the external DAG/task does
> not exist.
> The default value is set to *False* (no check or ceasing will happen) so it
> will not affect any existing DAGs or user expectation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
