MaksYermak commented on PR #72809:
URL: https://github.com/apache/airflow/pull/72809#issuecomment-5678873147

   > 1. With `append_job_name=False`, could the first five-second timeout pick 
a previous completed job while the new job is still being submitted?
   > 2. If the launcher exits without logging a job ID before the timeout, when 
would the API lookup run before deferring?
   
   1. Sorry I do not clearly understand the question, about what "first 
five-second timeout" are you talking? Could you please share a line in the code?
   **About creating Dataflow jobs when `append_job_name=False`.**
   For Apache Beam SDK only, Dataflow API raise `DataflowJobAlreadyExistsError` 
in case when user tries to create Job with the same `job_name` as the currently 
active Job has. Because for Beam operators we use only SDK for creating Job it 
means for as that we can use `job_name` as a parameter for monitoring Job's 
state. As we can be sure that in Dataflow we have only one Job with this name 
and in the running state.
   2. Sorry I do not understand this question either. What launcher is? What 
timeout are you talking about? What API did you mean? Could you please clarify 
it with sharing lines in the code?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to