Oduig commented on issue #9392: URL: https://github.com/apache/airflow/issues/9392#issuecomment-1422917743
I also have this issue, and wonder why it did not qualify as an issue in Airflow? In my case, it happens with the on_failure_callback of a DAG. The DAG has multiple tasks (without individual callbacks) and a DAG-level timeout of a few minutes. When the timeout is triggered, the running tasks are terminated (marked skipped) and the main DAG fails. It triggers the on_failure_callback not once, but twice with the same context. Is there any reason why that would happen twice? It's consistent and happens every time this DAG times out. The invocations are almost half a minute apart, I also checked the context and stack traces and they are exactly the same. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
