Kunal8954 commented on code in PR #72406:
URL: https://github.com/apache/airflow/pull/72406#discussion_r3999794506
##########
providers/google/src/airflow/providers/google/cloud/hooks/datafusion.py:
##########
@@ -133,8 +133,11 @@ def wait_for_pipeline_state(
namespace=namespace,
)
current_state = workflow["status"]
- except KeyError:
- pass # Because the pipeline may not be visible in system yet
+ except (HTTPError, KeyError):
+ # A 404 is raised as HTTPError by
_check_response_status_and_data, and a
+ # missing "status" key raises KeyError. Both mean the run is
not visible
+ # in the system yet, so keep polling instead of failing the
task.
+ pass
Review Comment:
Agreed, that makes sense. I’ll keep the expected 404 handling quiet and
focus on the underlying creation/status-tracking gap rather than adding noisy
error logs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
