Re: [I] [Bug]: RuntimeError: No dataflow job was found when running the python file. [beam]

[via GitHub]

Ox0400 commented on issue #35013:
URL: https://github.com/apache/beam/issues/35013#issuecomment-2908695423

   @liferoad Try can review this source code 
`dataflow_python_job_remote_runner.py`.
   
   
   
https://github.com/kubeflow/pipelines/blob/master/components/google-cloud/google_cloud_pipeline_components/container/v1/dataflow/dataflow_python_job_remote_runner.py
   
   ```
   
     for line in sub_process.read_lines():
       logging.info('DataflowRunner output: %s', line)
       job_id, location = extract_job_id_and_location(line)
       if job_id:
         logging.info('Found job id %s and location %s.', job_id, location)
         ...
         break
     if not job_id:
       raise RuntimeError(
           'No dataflow job was found when running the python file.'
       )
   ```
   
   
https://github.com/kubeflow/pipelines/blob/master/components/google-cloud/google_cloud_pipeline_components/container/v1/dataflow/dataflow_python_job_remote_runner.py#L33
   
   
https://github.com/kubeflow/pipelines/blob/master/components/google-cloud/google_cloud_pipeline_components/container/v1/dataflow/dataflow_python_job_remote_runner.py#L139
   
   
https://github.com/kubeflow/pipelines/blob/master/components/google-cloud/google_cloud_pipeline_components/container/v1/dataflow/dataflow_python_job_remote_runner.py#L106
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@beam.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org