I have a pipeline built using Apache Beam java SDK version 2.46.0 when submitting a job using:
gcloud dataflow jobs run cloud-pubsub-group-events-to-avro-$USER-`date +"%Y%m%d-%H%M"` \ --gcs-location gs://$TEMPLATES_BUCKET_NAME/images/$STAGING_DATE/ $TEMPLATE_NAME \ --project $PROJECT_ID --region $REGION \ --staging-location gs://$STAGING_BUCKET_NAME/images/$STAGING_DATE/staging/ \ --service-account-email=$SERVICE_ACCOUNT_EMAIL \ --worker-machine-type=n1-standard-8 \ --additional-experiments=use_runner_v2 \ --num-workers=2 \ --max-workers=15 \ --worker-region=$REGION \ --enable-streaming-engine \ --parameters \ inputTopic=$INPUT_TOPIC_NAME I get the following error: The workflow could not be created because portable pipelines using Apache Beam 2.46.0 must use Dataflow Runner V2, but Dataflow Runner V2 is disabled by one or more of the following experiments [disable_runner_v2, disable_prime_runner_v2, disable_prime_streaming_engine]. To create the workflow, enable Dataflow Runner V2. Following these descriptions seem to be outdated https://cloud.google.com/dataflow/docs/runner-v2. Does anyone know a solution for this issue ? Thanks -- Mario Costa Data Analytics Senior Software Developer <https://corp.frvr.com> <https://www.facebook.com/frvrgames> <https://pt.linkedin.com/company/frvr> <https://frvr.com/>
