sosso commented on issue #14205: URL: https://github.com/apache/airflow/issues/14205#issuecomment-821723114
After a few hours spelunking through the codebase, we came across `max_dagruns_per_loop_to_schedule` in `scheduler_job.py`. We have several thousand DAGs, all between 1-3 tasks (80% are probably 1 task) and this was a massive improvement for us in setting it to 200 (10x the default value of 20). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
