shahar1 commented on code in PR #72406:
URL: https://github.com/apache/airflow/pull/72406#discussion_r3999707503
##########
providers/google/src/airflow/providers/google/cloud/hooks/datafusion.py:
##########
@@ -133,8 +133,11 @@ def wait_for_pipeline_state(
namespace=namespace,
)
current_state = workflow["status"]
- except KeyError:
- pass # Because the pipeline may not be visible in system yet
+ except (HTTPError, KeyError):
+ # A 404 is raised as HTTPError by
_check_response_status_and_data, and a
+ # missing "status" key raises KeyError. Both mean the run is
not visible
+ # in the system yet, so keep polling instead of failing the
task.
+ pass
Review Comment:
Don't we want to log when it happens?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
