[ https://issues.apache.org/jira/browse/BEAM-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622449#comment-16622449 ]
Maximilian Michels commented on BEAM-5442: ------------------------------------------ Actually, if you look at {{get_all_options}} method you see it filter out all the options which are not part of a {{PipelineOptions}} class. See https://github.com/apache/beam/blob/master/sdks/python/apache_beam/options/pipeline_options.py#L212 So we just need to add a FlinkOptions derived from PipelineOptions to the Python SDK. > PortableRunner swallows custom options for Runner > ------------------------------------------------- > > Key: BEAM-5442 > URL: https://issues.apache.org/jira/browse/BEAM-5442 > Project: Beam > Issue Type: Bug > Components: sdk-java-core, sdk-py-core > Reporter: Maximilian Michels > Assignee: Maximilian Michels > Priority: Major > Labels: portability, portability-flink > Fix For: 2.8.0 > > > The PortableRunner doesn't pass custom PipelineOptions to the executing > Runner. > Example: {{--parallelism=4}} won't be forwarded to the FlinkRunner. > (The option is just removed during proto translation without any warning) > We should allow some form of customization through the options, even for the > PortableRunner. -- This message was sent by Atlassian JIRA (v7.6.3#76005)