ashb edited a comment on issue #14744: URL: https://github.com/apache/airflow/issues/14744#issuecomment-801089725
Ah, I wonder if the "correct" fix is then instead to look for zombie task in RUNNING or SHUTDOWN state, where as currently it only looks at them in the RUNNING state https://github.com/apache/airflow/blob/2a2adb3f94cc165014d746102e12f9620f271391/airflow/utils/dag_processing.py#L1077-L1089 I wonder if a related problem is that the LocalTaskJob is never cleaned up and left in the Running state even though it isn't heartbeating anymore. @larsjeh Could you go to Browse -> Jobs and see if you have a number of "old" LoclalTaskJobs in running? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
