[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17131284#comment-17131284 ] Beam JIRA Bot commented on BEAM-7868: - This issue was marked "stale-assigned" and has not received a public comment in 7 days. It is now automatically unassigned. If you are still working on it, you can assign it to yourself again. Please also give an update about the status of the work. > Hidden Flink Runner parameters are dropped in python pipelines > -- > > Key: BEAM-7868 > URL: https://issues.apache.org/jira/browse/BEAM-7868 > Project: Beam > Issue Type: Bug > Components: runner-flink >Reporter: Ankur Goenka >Priority: P2 > Time Spent: 0.5h > Remaining Estimate: 0h > > Hidden pipeline options for Portable flink runner are not interpreted by > Python SDK. > An example of this is > ManualDockerEnvironmentOptions.getRetainDockerContainers which is not > interpreted in python sdk. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121951#comment-17121951 ] Kenneth Knowles commented on BEAM-7868: --- This issue is assigned but has not received an update in 30 days so it has been labeled "stale-assigned". If you are still working on the issue, please give an update and remove the label. If you are no longer working on the issue, please unassign so someone else may work on it. In 7 days the issue will be automatically unassigned. > Hidden Flink Runner parameters are dropped in python pipelines > -- > > Key: BEAM-7868 > URL: https://issues.apache.org/jira/browse/BEAM-7868 > Project: Beam > Issue Type: Bug > Components: runner-flink >Reporter: Ankur Goenka >Assignee: Ankur Goenka >Priority: P2 > Labels: stale-assigned > Time Spent: 0.5h > Remaining Estimate: 0h > > Hidden pipeline options for Portable flink runner are not interpreted by > Python SDK. > An example of this is > ManualDockerEnvironmentOptions.getRetainDockerContainers which is not > interpreted in python sdk. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897713#comment-16897713 ] Ankur Goenka commented on BEAM-7868: Added the PR for more clarity > Hidden Flink Runner parameters are dropped in python pipelines > -- > > Key: BEAM-7868 > URL: https://issues.apache.org/jira/browse/BEAM-7868 > Project: Beam > Issue Type: Bug > Components: runner-flink >Reporter: Ankur Goenka >Assignee: Ankur Goenka >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Hidden pipeline options for Portable flink runner are not interpreted by > Python SDK. > An example of this is > ManualDockerEnvironmentOptions.getRetainDockerContainers which is not > interpreted in python sdk. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[
https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897712#comment-16897712
]
Ankur Goenka commented on BEAM-7868:
Beam has annotation
{code:java}
beam/sdks/java/core/src/main/java/org/apache/beam/sdk/options/Hidden.java
{code}
which can mark the pipeline options to be hidden example
ManualDockerEnvironmentOptions
These hidden pipeline options are not returned in
PipelineOptionsFactory.describe which is used by Python SDK in PortableRunner (
job_service.DescribePipelineOptions )
And here the unknown hidden options are dropped by SDK.
> Hidden Flink Runner parameters are dropped in python pipelines
> --
>
> Key: BEAM-7868
> URL: https://issues.apache.org/jira/browse/BEAM-7868
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Ankur Goenka
>Assignee: Ankur Goenka
>Priority: Major
>
> Hidden pipeline options for Portable flink runner are not interpreted by
> Python SDK.
> An example of this is
> ManualDockerEnvironmentOptions.getRetainDockerContainers which is not
> interpreted in python sdk.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897703#comment-16897703 ] Thomas Weise commented on BEAM-7868: What means "hidden" and what do you expect to happen? > Hidden Flink Runner parameters are dropped in python pipelines > -- > > Key: BEAM-7868 > URL: https://issues.apache.org/jira/browse/BEAM-7868 > Project: Beam > Issue Type: Bug > Components: runner-flink >Reporter: Ankur Goenka >Assignee: Ankur Goenka >Priority: Major > > Hidden pipeline options for Portable flink runner are not interpreted by > Python SDK. > An example of this is > ManualDockerEnvironmentOptions.getRetainDockerContainers which is not > interpreted in python sdk. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (BEAM-7868) Hidden Flink Runner parameters are dropped in python pipelines
[ https://issues.apache.org/jira/browse/BEAM-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897698#comment-16897698 ] Ankur Goenka commented on BEAM-7868: cc: [~thw] [~hulettbh] > Hidden Flink Runner parameters are dropped in python pipelines > -- > > Key: BEAM-7868 > URL: https://issues.apache.org/jira/browse/BEAM-7868 > Project: Beam > Issue Type: Bug > Components: runner-flink >Reporter: Ankur Goenka >Assignee: Ankur Goenka >Priority: Major > > Hidden pipeline options for Portable flink runner are not interpreted by > Python SDK. > An example of this is > ManualDockerEnvironmentOptions.getRetainDockerContainers which is not > interpreted in python sdk. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
