alkismavridis commented on issue #55768: URL: https://github.com/apache/airflow/issues/55768#issuecomment-3322662552
We are also affected. We are running Airflow 3.0.6 via docker compose. We are using LocalExecutor. The compose file starts couple of containers, all of which have pretty constant memory usage over time except from the scheduler which eats all available memory (we constrained it to 4GB), and then restarts. Restarting is actually the good scenario, because then it at least works. Sometimes it stays in a "zombie" state where it simply does nothing and no tasks are being triggered for days, until we realise that somethings is off. When this happens, we see in the WebUI tones of tasks being stuck on "Queued" state. Any help is most welcome. This makes our whole infrastructure unstable :( <img width="1872" height="298" alt="Image" src="https://github.com/user-attachments/assets/c040f2d5-e46b-4f96-a643-320025869387"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
