Hi Bruno, thanks for the info, I'll look into how I'm building it, and give it a try.
On Sat, May 27, 2023 at 5:54 PM Bruno Volpato <bvolp...@google.com> wrote: > Hi Mário, > > The template that you are using as --gcs-location has to be built with > Runner v2 enabled. The produced graph is not compatible across Runner v1 > and Runner v2. > > On Sat, May 27, 2023 at 11:28 AM XQ Hu via user <user@beam.apache.org> > wrote: > >> Can you check whether your code has any options that contain any of >> [disable_runner_v2, disable_prime_runner_v2, >> disable_prime_streaming_engine]? >> >> On Sat, May 27, 2023 at 5:29 AM Mário Costa via user < >> user@beam.apache.org> wrote: >> >>> I have a pipeline built using Apache Beam java SDK version 2.46.0 when >>> submitting a job using: >>> >>> gcloud dataflow jobs run cloud-pubsub-group-events-to-avro-$USER-`date >>> +"%Y%m%d-%H%M"` \ >>> --gcs-location gs://$TEMPLATES_BUCKET_NAME/images/$STAGING_DATE/ >>> $TEMPLATE_NAME \ >>> --project $PROJECT_ID --region $REGION \ >>> --staging-location gs://$STAGING_BUCKET_NAME/images/$STAGING_DATE >>> /staging/ \ >>> --service-account-email=$SERVICE_ACCOUNT_EMAIL \ >>> --worker-machine-type=n1-standard-8 \ >>> --additional-experiments=use_runner_v2 \ >>> --num-workers=2 \ >>> --max-workers=15 \ >>> --worker-region=$REGION \ >>> --enable-streaming-engine \ >>> --parameters \ >>> inputTopic=$INPUT_TOPIC_NAME >>> >>> I get the following error: >>> >>> The workflow could not be created because portable pipelines using >>> Apache Beam 2.46.0 must use Dataflow Runner V2, but Dataflow Runner V2 is >>> disabled by one or more of the following experiments [disable_runner_v2, >>> disable_prime_runner_v2, disable_prime_streaming_engine]. To create the >>> workflow, enable Dataflow Runner V2. >>> >>> Following these descriptions seem to be outdated >>> https://cloud.google.com/dataflow/docs/runner-v2. >>> >>> Does anyone know a solution for this issue ? >>> Thanks >>> >>> -- >>> >>> Mario Costa >>> Data Analytics Senior Software Developer >>> >>> >>> >>> <https://corp.frvr.com> <https://www.facebook.com/frvrgames> >>> <https://pt.linkedin.com/company/frvr> >>> >>> >>> >>> >>> <https://frvr.com/> >>> >> -- Mario Costa Data Analytics Senior Software Developer <https://corp.frvr.com> <https://www.facebook.com/frvrgames> <https://pt.linkedin.com/company/frvr> <https://frvr.com/>
