larsjeh commented on issue #14744: URL: https://github.com/apache/airflow/issues/14744#issuecomment-800915354
Thanks for your response @ashb! For some reason, the tasks remain in the shutdown state and are not failing automatically. We have a setup with AWS ECS containers where we redeploy the containers after dependency changes etc. Smaller changes are synced over EFS. I have a feeling that the tasks end up in the shutdown state after/during a new deployment. It appears that the worker, that is currently processing a task, is taken down by the orchestrator causing the task to go into the shutdown state. Unfortunately, the tasks are not failed automatically afterward and they remain in the shutdown state. This results in new dagruns that are not scheduled if `max_active_runs=1`. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
