[
https://issues.apache.org/jira/browse/BEAM-9802?focusedWorklogId=446964&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-446964
]
ASF GitHub Bot logged work on BEAM-9802:
----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Jun/20 22:39
Start Date: 16/Jun/20 22:39
Worklog Time Spent: 10m
Work Description: TheNeuralBit commented on a change in pull request
#11495:
URL: https://github.com/apache/beam/pull/11495#discussion_r441181319
##########
File path: sdks/python/apache_beam/options/pipeline_options.py
##########
@@ -425,6 +425,24 @@ def _add_argparse_args(cls, parser):
help='Whether to enable streaming mode.')
+class CrossLanguageOptions(PipelineOptions):
+ @classmethod
Review comment:
I was able to use this to override the jar used in SqlTransform. The one
gotcha was that the artifact name had to exactly match the one in
BeamJarExpansionService (in my case I had omitted the leading ":").
I did run into another issue though. When I set this parameter and run on
Dataflow the job fails because workers are unable to parse this arg. It seems
somewhere along the line it's translate to a python dictionary like
`{':sdks:java:..': '/blah/blah'}` and no longer valid json.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 446964)
Time Spent: 1h 40m (was: 1.5h)
> Provide a way to customize automatically started services.
> ----------------------------------------------------------
>
> Key: BEAM-9802
> URL: https://issues.apache.org/jira/browse/BEAM-9802
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Robert Bradshaw
> Assignee: Robert Bradshaw
> Priority: P2
> Fix For: 2.22.0
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> This can be useful for testing and alternative production environments.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
