ammppp commented on issue #28715: URL: https://github.com/apache/beam/issues/28715#issuecomment-1745243883
I believe the reason the pipeline fails on 2.50 is because of this: https://github.com/apache/beam/issues/28399 Effectively, when a pipeline is created/run like the example below, it ends up trying to use the Dataflow Runner V1 which is no longer allowed from Beam SDK 2.50+: `p = beam.Pipeline(InteractiveRunner()) DataflowRunner().run_pipeline(p, options=options)` A workaround (until 2.51 is released) is to manually specify the "--experiments=use_runner_v2" in the pipeline options. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
