aru-trackunit commented on issue #36998: URL: https://github.com/apache/airflow/issues/36998#issuecomment-2061097209
I see similarity between the issue we are facing and the one you describe. Airflow 2.8.4 We run one instance of scheduler and we observe a list of completed tasks (usually cleared) like here: https://github.com/apache/airflow/issues/33402),  Config: - core parallelism = 32 - default pool slots = 128 <img width="1267" alt="Screenshot 2024-04-15 at 15 26 19" src="https://github.com/apache/airflow/assets/93520526/fba91871-9444-4a6d-b5b6-f2dbd048a5d8";> At 3 AM there were supposed to run more tasks but nothing like that happened. In the morning we ended up having no running tasks, many in queued state -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
