Angela Zhang created AIRFLOW-1689:
-------------------------------------
Summary: Airflow doesn't schedule tasks if there are too many
failed tasks in a previous dag run
Key: AIRFLOW-1689
URL: https://issues.apache.org/jira/browse/AIRFLOW-1689
Project: Apache Airflow
Issue Type: Bug
Reporter: Angela Zhang
see: !https://cl.ly/0I272J1N1N0m!
This happens to multiple of our dags, where if previous dag runs of this dag
have too many failed / running tasks (even though it's still lower than the
concurrency / max active dags runs, concurrency=16, max_active_runs=16), the
scheduler does not schedule any more tasks in the latest dag run for this dag.
!https://cl.ly/3g1E1e2h0634!
We can make the scheduler schedule more tasks if we mark the previous dag runs
as successful, but this still seems like a bug in airflow.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
