turbaszek commented on issue #8806: URL: https://github.com/apache/airflow/issues/8806#issuecomment-630633955
Hi, @mdnawed2010 you are right. Hee's another comment on that issue: https://github.com/apache/airflow/pull/6371#issuecomment-586502594 New operators accept `request_id` which if I'm correct works in the same way: > > Doesn't request_id work like that? > If the server receives two SubmitJobRequest requests with the same id, then the second request will be ignored and the first Job created and stored in the backend is returned. https://googleapis.dev/python/dataproc/latest/gapic/v1/api.html#google.cloud.dataproc_v1.JobControllerClient.submit_job ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
