chamikaramj opened a new issue, #26576: URL: https://github.com/apache/beam/issues/26576
### What happened? Seems like Java x-lang jobs are failing for Beam 2.47.0 RC3 due to not being able to download/setup the Python SDK harness container. Example: Container: gcr.io/cloud-dataflow/v1beta3/beam_python3.9_sdk:2.47.0 Job: https://pantheon.corp.google.com/dataflow/jobs/us-central1/2023-05-06_01_31_45-3741497213019956539;graphView=0?project=apache-beam-testing&pageState=(%22dfTime%22:(%22l%22:%22dfJobMaxTime%22)) Errors: https://pantheon.corp.google.com/logs/query;query=resource.type%3D%22dataflow_step%22%0Aresource.labels.job_id%3D%222023-05-06_01_31_45-3741497213019956539%22%0AlogName%3D%22projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fkubelet%22%0Aseverity%3E%3DERROR;cursorTimestamp=2023-05-06T08:35:54.258518Z?project=apache-beam-testing Error syncing pod, skipping" err="failed to "StartContainer" for "sdk-1-0" with CrashLoopBackOff: "back-off 10s restarting failed container=sdk-1-0 pod=df-pythondataframewordcount--05060131-tupl-harness-pnng_default(9d9011b47f48e0b652f8d16cf81e8f8c)"" pod="default/df-pythondataframewordcount--05060131-tupl-harness-pnng" podUID=9d9011b47f48e0b652f8d16cf81e8f8c I'm getting the same error when running with the container overridden to use a clone in my private repo, so this is unlikely to be a GCR issue. The same job works fine with Beam 2.46.0 so seems like there's some issue with Beam 2.47.0 artifacts. https://pantheon.corp.google.com/dataflow/jobs/us-central1/2023-05-06_01_15_41-10489984441407428074;bottomTab=WORKER_LOGS;logsSeverity=INFO;graphView=0?project=apache-beam-testing&pageState=(%22dfTime%22:(%22l%22:%22dfJobMaxTime%22)) To reproduce, run the multi-lang quickstart job with a manual expansion service container and using Python 2.47.0 artifacts. https://beam.apache.org/documentation/sdks/java-multi-language-pipelines/ Creating this as a blocker for the ongoing RC since this breaks a feature that worked for the previous release. ### Issue Priority Priority: 3 (minor) ### Issue Components - [ ] Component: Python SDK - [ ] Component: Java SDK - [ ] Component: Go SDK - [ ] Component: Typescript SDK - [ ] Component: IO connector - [ ] Component: Beam examples - [ ] Component: Beam playground - [ ] Component: Beam katas - [ ] Component: Website - [ ] Component: Spark Runner - [ ] Component: Flink Runner - [ ] Component: Samza Runner - [ ] Component: Twister2 Runner - [ ] Component: Hazelcast Jet Runner - [ ] Component: Google Cloud Dataflow Runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
