Can you check whether your code has any options that contain any of [disable_runner_v2, disable_prime_runner_v2, disable_prime_streaming_engine]?
On Sat, May 27, 2023 at 5:29 AM Mário Costa via user <user@beam.apache.org> wrote: > I have a pipeline built using Apache Beam java SDK version 2.46.0 when > submitting a job using: > > gcloud dataflow jobs run cloud-pubsub-group-events-to-avro-$USER-`date > +"%Y%m%d-%H%M"` \ > --gcs-location gs://$TEMPLATES_BUCKET_NAME/images/$STAGING_DATE/ > $TEMPLATE_NAME \ > --project $PROJECT_ID --region $REGION \ > --staging-location gs://$STAGING_BUCKET_NAME/images/$STAGING_DATE/staging/ > \ > --service-account-email=$SERVICE_ACCOUNT_EMAIL \ > --worker-machine-type=n1-standard-8 \ > --additional-experiments=use_runner_v2 \ > --num-workers=2 \ > --max-workers=15 \ > --worker-region=$REGION \ > --enable-streaming-engine \ > --parameters \ > inputTopic=$INPUT_TOPIC_NAME > > I get the following error: > > The workflow could not be created because portable pipelines using Apache > Beam 2.46.0 must use Dataflow Runner V2, but Dataflow Runner V2 is disabled > by one or more of the following experiments [disable_runner_v2, > disable_prime_runner_v2, disable_prime_streaming_engine]. To create the > workflow, enable Dataflow Runner V2. > > Following these descriptions seem to be outdated > https://cloud.google.com/dataflow/docs/runner-v2. > > Does anyone know a solution for this issue ? > Thanks > > -- > > Mario Costa > Data Analytics Senior Software Developer > > > > <https://corp.frvr.com> <https://www.facebook.com/frvrgames> > <https://pt.linkedin.com/company/frvr> > > > > > <https://frvr.com/> >
