hussein-awala commented on issue #30289: URL: https://github.com/apache/airflow/issues/30289#issuecomment-1483728307
I am not sure if we should consider this as a bug or a new feature. (@potiuk) When the poke method raises an exception, the sensor task fails, and a new task instance will be created if you provide `retries` > 0 (50 in your example). For now, you should handle this failure by yourself, and return `False` when you want to skip the exception. But as a new feature, I added in #30293 a new param `silent_fail` to catch the exceptions (except 4 Airflow exceptions) and log it instead of failing the task, in this case the execution will be continue in the same retry. WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
