Hi Mário, The template that you are using as --gcs-location has to be built with Runner v2 enabled. The produced graph is not compatible across Runner v1 and Runner v2.
On Sat, May 27, 2023 at 11:28 AM XQ Hu via user <user@beam.apache.org> wrote: > Can you check whether your code has any options that contain any of > [disable_runner_v2, disable_prime_runner_v2, > disable_prime_streaming_engine]? > > On Sat, May 27, 2023 at 5:29 AM Mário Costa via user <user@beam.apache.org> > wrote: > >> I have a pipeline built using Apache Beam java SDK version 2.46.0 when >> submitting a job using: >> >> gcloud dataflow jobs run cloud-pubsub-group-events-to-avro-$USER-`date >> +"%Y%m%d-%H%M"` \ >> --gcs-location gs://$TEMPLATES_BUCKET_NAME/images/$STAGING_DATE/ >> $TEMPLATE_NAME \ >> --project $PROJECT_ID --region $REGION \ >> --staging-location gs://$STAGING_BUCKET_NAME/images/$STAGING_DATE >> /staging/ \ >> --service-account-email=$SERVICE_ACCOUNT_EMAIL \ >> --worker-machine-type=n1-standard-8 \ >> --additional-experiments=use_runner_v2 \ >> --num-workers=2 \ >> --max-workers=15 \ >> --worker-region=$REGION \ >> --enable-streaming-engine \ >> --parameters \ >> inputTopic=$INPUT_TOPIC_NAME >> >> I get the following error: >> >> The workflow could not be created because portable pipelines using Apache >> Beam 2.46.0 must use Dataflow Runner V2, but Dataflow Runner V2 is disabled >> by one or more of the following experiments [disable_runner_v2, >> disable_prime_runner_v2, disable_prime_streaming_engine]. To create the >> workflow, enable Dataflow Runner V2. >> >> Following these descriptions seem to be outdated >> https://cloud.google.com/dataflow/docs/runner-v2. >> >> Does anyone know a solution for this issue ? >> Thanks >> >> -- >> >> Mario Costa >> Data Analytics Senior Software Developer >> >> >> >> <https://corp.frvr.com> <https://www.facebook.com/frvrgames> >> <https://pt.linkedin.com/company/frvr> >> >> >> >> >> <https://frvr.com/> >> >
