[
https://issues.apache.org/jira/browse/AIRFLOW-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxime Beauchemin updated AIRFLOW-1019:
---------------------------------------
Fix Version/s: (was: 1.8.1)
1.9.0
> active_dagruns shouldn't include paused DAGs
> --------------------------------------------
>
> Key: AIRFLOW-1019
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1019
> Project: Apache Airflow
> Issue Type: Improvement
> Components: scheduler
> Affects Versions: 1.8.0
> Reporter: Dan Davydov
> Priority: Critical
> Fix For: 1.9.0
>
>
> Since 1.8.0 Airflow resets orphaned tasks (tasks that are in the DB but not
> in the executor's memory). The problem is that Airflow counts dagruns in
> paused DAGs as running as long as the dagruns state is running. Instead we
> should join against non-paused DAGs everywhere we calculate active dagruns
> (e.g. in _process_task_instances in the Scheduler class in jobs.py). If there
> are enough paused DAGs it brings the scheduler to a halt especially on
> scheduler restarts.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
