Russell Pierce created AIRFLOW-761:
--------------------------------------
Summary: Subdag Fails to Detect Completion of tasks
Key: AIRFLOW-761
URL: https://issues.apache.org/jira/browse/AIRFLOW-761
Project: Apache Airflow
Issue Type: Bug
Components: scheduler
Affects Versions: Airflow 1.7.1.3
Environment: Ubuntu 14.04.4 LTS
MySQL 5.6.27 (AWS RDS)
CeleryExecutor
Reporter: Russell Pierce
Priority: Minor
Using the CeleryExecutor - I have a pretty basic SubDagOperator the tasks in
the DAG are generated by a factory and use a queue pool (if that matters, IDK).
What happens is that the SubDagOperator never gets marked as success despite
all tasks associated with the job being marked as success. I've validated that
all have been marked as success via the webserver as well as a direct query of
the task_instance table. Some part of the scheduler doesn't realize that ~ two
of the tasks on any given day have reached completion.
I'm not sure what else is needed here for a successful bug report. Please LMK.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)