ephraimbuddy opened a new pull request #16182: URL: https://github.com/apache/airflow/pull/16182
Currently, if a dag goes missing, the scheduler continues to queue the task instances until the executor reports the tasks as failed and then the scheduler would now set the state to failed. This change ensures that tasks are not queued when the dag goes missing. Instead of waiting on the executor to fail the task without explicit reason, the task fails here with the reason why it failed. Thanks to this, the Pool's queued slots will be freed for other tasks to be queued Closes: https://github.com/apache/airflow/issues/15488 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed. In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x). In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
