Johannes Wienke created AIRFLOW-6853:
----------------------------------------
Summary: ExternalTaskSensor does not work with packaged DAGs
Key: AIRFLOW-6853
URL: https://issues.apache.org/jira/browse/AIRFLOW-6853
Project: Apache Airflow
Issue Type: Bug
Components: operators
Affects Versions: 1.10.9
Reporter: Johannes Wienke
The current implementation of ExternalTaskSensor uses the file location of a
DAG to determine if it still exists. This is realized by the following code
fragment:
{code:python}
if not os.path.exists(dag_to_wait.fileloc):
raise AirflowException('The external DAG '
'{} was
deleted.'.format(self.external_dag_id)
{code}
In case the DAG to check is part of a Zip archive, fileloc looks something
like: {{/usr/local/airflow/dags/analytics.zip/create_keyframes.py}}. This can
obviously not be checked with {{os.path.exists}} and therefore the sensor is
currently unable to handle packaged DAGs at all.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)