VladaZakharova commented on code in PR #54101:
URL: https://github.com/apache/airflow/pull/54101#discussion_r2253769968
##########
providers/google/src/airflow/providers/google/cloud/triggers/cloud_storage_transfer_service.py:
##########
@@ -87,13 +88,9 @@ async def run(self) -> AsyncIterator[TriggerEvent]:
for job, operation in zip(jobs, operations):
if operation is None:
- yield TriggerEvent(
- {
- "status": "error",
- "message": f"Transfer job {job.name} has no
latest operation.",
- }
- )
- return
+ self.log.info("Transfer job %s has no latest operation
yet, waiting.", job.name)
+ all_operations_found = False
+ continue
Review Comment:
hi, thank you for changes
I am not fully okay with checking for infinite time until we can the
operation for every job. This can lead to unfinished trigger at all and we can
easily get stuck here during execution. Maybe we can put a limit of retries for
every run to verify if the operation for every job exists?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
