karthik-raparthi commented on issue #10790:
URL: https://github.com/apache/airflow/issues/10790#issuecomment-1255482668
Thanks, @V0lantis & @potiuk for the inputs. Yes, we are in process of
moving away from EFS. but trying to see any workarounds to find the issue once
it struck in Queue by using some alerts.
I did some research and looks like we can rely on the task_instance table on
Airflow metadb to alert as soon as a Task struck in Q for more than 30
mins(this time might vary based on EFS)
`select
*
from
task_instance ti
where
start_date is null
and end_date is null
and pid is null
and state = 'queued'
and queued_dttm < now() - interval '30 min';`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
