DrYampy commented on issue #36963: URL: https://github.com/apache/airflow/issues/36963#issuecomment-2499569710
ok So i compensated by having a follow on task fetch the logs - however, if the task fails, you never get back the xcom for the job - furthermore, the xcom doesnt actually point to the execution name but rather the job itself (which I can also fix) I ended up implementing my own CloudRunExecuteJobOperator that waits for the jov to complete then gets the logs for the job using the GCP logging client - feels like its more lightweight since it is one API call vs a constant polling.... Any interest in my contributing it back in a PR @potiuk? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
