tirkarthi commented on issue #58554: URL: https://github.com/apache/airflow/issues/58554#issuecomment-3567340988
My guess is that you might be hitting one of the below since by default scheduler examines 20 dagruns by default and with 30 concurrent tasks it might lead to this dagrun not picked up. There are tips to fine tune the scheduler and I was referring to max_dagruns_per_loop_to_schedule with 20 as default value. You can also enable debug log or run scheduler with `-vvv` that should give you more logs to see when the task and dagrun is being picked up for queuing. https://github.com/apache/airflow/issues/49508 https://github.com/apache/airflow/issues/45636 https://airflow.apache.org/docs/apache-airflow/2.5.1/administration-and-deployment/scheduler.html#how-to-approach-scheduler-s-fine-tuning -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
