Dan Davydov created AIRFLOW-2173:
------------------------------------

             Summary: Don't check task IDs for concurrency reached check
                 Key: AIRFLOW-2173
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2173
             Project: Apache Airflow
          Issue Type: Bug
          Components: core
            Reporter: Dan Davydov
            Assignee: Dan Davydov


Currently the concurrency reached check does a filter in the DB query to only 
include tasks that are currently in the parsed DAG. For sufficiently large DAGs 
with many tasks, this causes mysql to use an inefficient query plan and can put 
a lot of load on the database. Since there is no good reason to omit old 
running tasks in a DAG from concurrency, this filter should just be removed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to