Dan Davydov created AIRFLOW-1019:
------------------------------------
Summary: active_dagruns shouldn't include paused DAGs
Key: AIRFLOW-1019
URL: https://issues.apache.org/jira/browse/AIRFLOW-1019
Project: Apache Airflow
Issue Type: Bug
Reporter: Dan Davydov
Priority: Critical
Since 1.8.0 Airflow resets orphaned tasks (tasks that are in the DB but not in
the executor's memory). The problem is that Airflow counts dagruns in paused
DAGs as running as long as the dagruns state is running. Instead we should join
against non-paused DAGs everywhere we calculate active dagruns (e.g. in
_process_task_instances in the Scheduler class in jobs.py). If there are enough
paused DAGs it brings the scheduler to a halt especially on scheduler restarts.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
