TheNeuralBit commented on a change in pull request #11495:
URL: https://github.com/apache/beam/pull/11495#discussion_r441181319
##########
File path: sdks/python/apache_beam/options/pipeline_options.py
##########
@@ -425,6 +425,24 @@ def _add_argparse_args(cls, parser):
help='Whether to enable streaming mode.')
+class CrossLanguageOptions(PipelineOptions):
+ @classmethod
Review comment:
I was able to use this to override the jar used in SqlTransform. The one
gotcha was that the artifact name had to exactly match the one in
BeamJarExpansionService (in my case I had omitted the leading ":").
I did run into another issue though. When I set this parameter and run on
Dataflow the job fails because workers are unable to parse this arg. It seems
somewhere along the line it's translate to a python dictionary like
`{':sdks:java:..': '/blah/blah'}` and no longer valid json.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
