githubwua commented on issue #30007: URL: https://github.com/apache/airflow/issues/30007#issuecomment-1552569028
You are right. I was asked to take a look at this issue, and didn't have a chance to read the issue description in detail. I was only checking successful runs so I was able to get the dataflow job ids. The dataflow job id is indeed only available after a Dataflow job finishes successfully. It is not available when a Dataflow job starts or while it is running. In a perfect world where no issue occurs, this is fine, but in the real world, when a Dataflow job gets cancelled, there is no job id to track the cancelled Dataflow job. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
