[
https://issues.apache.org/jira/browse/BEAM-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Myrvold resolved BEAM-3584.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.3.0
Fixed. Image has been published and dataflow jobs succeed now.
> Java dataflow job fails with 2.3.0 RC1, due to missing worker image
> -------------------------------------------------------------------
>
> Key: BEAM-3584
> URL: https://issues.apache.org/jira/browse/BEAM-3584
> Project: Beam
> Issue Type: Bug
> Components: examples-java
> Affects Versions: 2.3.0
> Reporter: Alan Myrvold
> Assignee: Alan Myrvold
> Priority: Blocker
> Fix For: 2.3.0
>
>
> Dataflow java jobs currently fail due to a missing docker image when using
> 2.3.0 RC1. This is not a bug in the SDK, the worker image needs to be
> published by google. I will be coordinating the worker image publication.
> # Update to your own project and bucket.
> GCS_BUCKET=my-cloud-storage-bucket
> GCP_PROJECT=my-cloud-project
> mkdir -p ~/try2.3.0/.m2/repository
> cd ~/try2.3.0/.m2/repository
> wget
> [https://repository.apache.org/content/repositories/orgapachebeam-1026/archetype-catalog.xml]
> cd ~/try2.3.0
> echo
> "<settings><localRepository>$PWD/.m2/repository</localRepository><profiles><profile><id>testrel</id><repositories><repository><id>testrel</id><url>[https://repository.apache.org/content/repositories/orgapachebeam-1026]</url></repository></repositories></profile></profiles></settings>"
> > settings.xml
> mvn archetype:generate -DarchetypeCatalog=local
> -DarchetypeGroupId=org.apache.beam
> -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples
> -DarchetypeVersion=2.3.0 -DgroupId=org.example
> -DartifactId=word-count-beam -Dversion="0.1"
> -Dpackage=org.apache.beam.examples -s settings.xml
> # answer yes
> cd word-count-beam
> mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount
> -Dexec.args="--runner=DataflowRunner --project=alan-jenkins-test
> --gcpTempLocation=gs://${GCS_BUCKET}/tmp
> --inputFile=gs://apache-beam-samples/shakespeare/*
> --output=gs://${GCP_PROJECT}e/counts" -s ../settings.xml
> -Ptestrel,dataflow-runner
>
> Dataflow logs contain:
> E Handler for GET
> /v1.27/images/dataflow.gcr.io/v1beta3/beam-java-batch:beam-2.3.0/json
> returned error: No such image:
> dataflow.gcr.io/v1beta3/beam-java-batch:beam-2.3.0
> E PullImage "dataflow.gcr.io/v1beta3/beam-java-batch:beam-2.3.0" from image
> service failed: rpc error: code = 2 desc = Error: Status 405 trying to pull
> repository v1beta3/beam-java-batch: "v1 Registry API is disabled. If you are
> not explicitly using the v1 Registry API, it is possible your v2 image could
> not be found. Verify that your image is available, or retry with `dockerd
> --disable-legacy-registry`. See
> https://cloud.google.com/container-registry/docs/support/deprecation-notices";
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
