vividbaek opened a new pull request, #75004: URL: https://github.com/apache/airflow/pull/75004
Deferred sensors with `soft_fail=True` currently turn unexpected errors into skips, hiding missing resources and trigger failures. Preserve these errors on resume and apply `soft_fail` to the same exception types as the regular sensor execution path: `AirflowSensorTimeout`, `AirflowTaskTimeout`, and `AirflowFailException`. Also catch `AirflowTaskTimeout` on resume so both `soft_fail` and `never_fail` can convert it to a skip. This extends `never_fail` handling for task timeouts; its handling of other errors is unchanged. Validation: - Updated sensor test file: 52 passed on upstream main at `9ad8d78c27` (Python 3.11, Breeze). - Identical tests against the original implementation at `7a479a62e6`: 5 failed, 47 passed. Failures cover generic errors, missing resources, trigger failure, and task timeouts under both flags. - Ruff, pre-commit checks (including Task SDK mypy), and applicable manual checks passed. This follows the behavior discussed in the closed, unmerged PR #72053. Full worker/triggerer integration has not been tested. closes: #71255 --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Codex (GPT-6); Antigravity assisted with review. Generated-by: Codex (GPT-6) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
