eladkal commented on issue #39219: URL: https://github.com/apache/airflow/issues/39219#issuecomment-2120292442
> Some of the SQL Sensors from time to time does not respect the timeout interval and run the entire DAG for multiple days. The sensors we use have waiting timeout 12 hours and usually starts after midnight or early morning. Normally all sensors finish - either skips (soft fail = True) or succeeds - by afternoon. However from time to time it happen that the sensor has one or more retries, and it is running for more than 24 or 36 hours. In the last case I thought maybe the counting is from the last retry attempt, but no, because the log says it started to poke 17 hours ago. I assume you have `mod=reschedule` ? If so I assume you are using `execution_timeout` parameter and missing `timeout` parameter. If so please read https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/tasks.html#timeouts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
