amichai07 opened a new pull request #4614: Decreasing scheduler delay between tasks URL: https://github.com/apache/airflow/pull/4614 ### Jira - My PR addresses the following https://issues.apache.org/jira/browse/AIRFLOW-3607 and references them in the PR title - Decreasing scheduler delay between tasks ### Description - The delay between tasks can be a major issue, especially when we have dags with many subdags, figures out that the scheduling process spends plenty of time in dependency checking, we took the trigger rule dependency which calls the db for each task instance, we made it call the db just once for each dag_run. ### Tests - My PR does not need extra testing for this extremely good reason: My pr uses the code from the and also has a fall back to the original behaviour, the ci covers all of the logic and cases that might happen already ### Commits - removed unnecessary queries - run on each dag run instead of each ti ### Documentation no need for new docs ### Code Quality - Passes `flake8`
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
