Kjir commented on issue #69658: URL: https://github.com/apache/airflow/issues/69658#issuecomment-4936243869
Indeed the issue is indeed the number of schedulers + `max_dagruns_per_loop_to_schedule`. It's a bit strange that darguns that cannot be executed currently hold a slot in the scheduler, IMO, especially when there is `depends_on_past` involved. Maybe there's technical reasons I cannot see, but I would expect the dag runs with an older date would be queued behind dag runs with a newer one. I believe backfills are always queued after scheduled runs and that's why if the pool fills up they are left starved for resources? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
