[
https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897712#comment-16897712
]
Ankur Goenka commented on BEAM-7868:
------------------------------------
Beam has annotation
{code:java}
beam/sdks/java/core/src/main/java/org/apache/beam/sdk/options/Hidden.java
{code}
which can mark the pipeline options to be hidden example
ManualDockerEnvironmentOptions
These hidden pipeline options are not returned in
PipelineOptionsFactory.describe which is used by Python SDK in PortableRunner (
job_service.DescribePipelineOptions )
And here the unknown hidden options are dropped by SDK.
> Hidden Flink Runner parameters are dropped in python pipelines
> --------------------------------------------------------------
>
> Key: BEAM-7868
> URL: https://issues.apache.org/jira/browse/BEAM-7868
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Ankur Goenka
> Assignee: Ankur Goenka
> Priority: Major
>
> Hidden pipeline options for Portable flink runner are not interpreted by
> Python SDK.
> An example of this is
> ManualDockerEnvironmentOptions.getRetainDockerContainers which is not
> interpreted in python sdk.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
