Abacn commented on issue #25966: URL: https://github.com/apache/beam/issues/25966#issuecomment-1485890579
Using beam provided container image (`--sdk_container_image=gcr.io/apache-beam-testing/beam-sdk/beam_python3.10_sdk:latest`), re-installation of the SDK is somewhat faster, however still takes 2min30s (1 minutes faster than default, Dataflow provided image). Building the wheel takes 2min20s. jobId: `2023-03-27_14_11_55-1971041453326172975` ``` 2023-03-27 17:15:14.903 EDT 2023/03/27 21:15:14 Found artifact: dataflow_python_sdk.tar 2023-03-27 17:15:14.903 EDT 2023/03/27 21:15:14 Installing setup packages ... 2023-03-27 17:15:15.444 EDT Processing /var/opt/google/staged/dataflow_python_sdk.tar 2023-03-27 17:15:15.937 EDT Preparing metadata (setup.py): started 2023-03-27 17:15:19.149 EDT Preparing metadata (setup.py): finished with status 'done' ... 2023-03-27 17:15:20.042 EDT Building wheels for collected packages: apache-beam 2023-03-27 17:15:20.043 EDT Building wheel for apache-beam (setup.py): started 2023-03-27 17:16:40.346 EDT Building wheel for apache-beam (setup.py): still running... 2023-03-27 17:17:39.535 EDT Building wheel for apache-beam (setup.py): finished with status 'done' ... 2023-03-27 17:17:39.559 EDT Successfully built apache-beam 2023-03-27 17:17:40.178 EDT Installing collected packages: apache-beam ... 2023-03-27 17:17:42.247 EDT Successfully installed apache-beam-2.47.0.dev0 ``` based on this experiment #25970 could still save 2.5 minutes per test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
