[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515887#comment-15515887
]
Maximilian Michels commented on BEAM-642:
-
That's good to know. I added you as a contributor.
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Sumit Chawla
> Fix For: 0.3.0-incubating
>
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {code}
> LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> {code}
> {code}
> org.apache.flink.api.common.InvalidProgramException: Job was submitted in
> detached mode. Results of job execution, such as accumulators, runtime, job
> id etc. are not available.
> at
> org.apache.flink.client.program.DetachedEnvironment$DetachedJobExecutionResult.getNetRuntime(DetachedEnvironment.java:98)
> ~[flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:48)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:183)
> ~[beam-sdks-java-core-0.2.0-incubating.jar:0.2.0-incubating]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_92]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_92]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_92]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_92]
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:320)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:777)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:253)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513831#comment-15513831
]
Sumit Chawla commented on BEAM-642:
---
[~maxmil23] [~amitsela] Sorry i did not have permission to create a new issue.
So i cloned an existing one and updated that one. I could not change the
assignee as well.
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Sumit Chawla
> Fix For: 0.3.0-incubating
>
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {code}
> LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> {code}
> {code}
> org.apache.flink.api.common.InvalidProgramException: Job was submitted in
> detached mode. Results of job execution, such as accumulators, runtime, job
> id etc. are not available.
> at
> org.apache.flink.client.program.DetachedEnvironment$DetachedJobExecutionResult.getNetRuntime(DetachedEnvironment.java:98)
> ~[flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:48)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:183)
> ~[beam-sdks-java-core-0.2.0-incubating.jar:0.2.0-incubating]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_92]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_92]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_92]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_92]
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:320)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:777)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:253)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513164#comment-15513164
]
Maximilian Michels commented on BEAM-642:
-
I was also wondering why you were assigned. Not that I mind :)
Actually, you got assigned because the issue was originally falsely tagged with
the "runner-spark" component. This component has you as the default assignee.
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Sumit Chawla
> Fix For: 0.3.0-incubating
>
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {code}
> LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> {code}
> {code}
> org.apache.flink.api.common.InvalidProgramException: Job was submitted in
> detached mode. Results of job execution, such as accumulators, runtime, job
> id etc. are not available.
> at
> org.apache.flink.client.program.DetachedEnvironment$DetachedJobExecutionResult.getNetRuntime(DetachedEnvironment.java:98)
> ~[flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:48)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:183)
> ~[beam-sdks-java-core-0.2.0-incubating.jar:0.2.0-incubating]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_92]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_92]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_92]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_92]
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:320)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:777)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:253)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512839#comment-15512839
]
Amit Sela commented on BEAM-642:
[~mxm] I really have no idea what happened here - my guess is this ticket was
built on top of a clone of BEAM-637. I definitely wasn't assigned to any
FlinkRunner tickets AFAIK.
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Sumit Chawla
> Fix For: 0.3.0-incubating
>
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {code}
> LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> {code}
> {code}
> org.apache.flink.api.common.InvalidProgramException: Job was submitted in
> detached mode. Results of job execution, such as accumulators, runtime, job
> id etc. are not available.
> at
> org.apache.flink.client.program.DetachedEnvironment$DetachedJobExecutionResult.getNetRuntime(DetachedEnvironment.java:98)
> ~[flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:116)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:48)
> ~[beam-runners-flink_2.10-0.2.0-incubating.jar:0.2.0-incubating]
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:183)
> ~[beam-sdks-java-core-0.2.0-incubating.jar:0.2.0-incubating]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_92]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_92]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_92]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_92]
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:320)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at
> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:777)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:253)
> [flink-clients_2.10-1.1.2.jar:1.1.2]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504855#comment-15504855
]
ASF GitHub Bot commented on BEAM-642:
-
GitHub user sumitchawla opened a pull request:
https://github.com/apache/incubator-beam/pull/974
BEAM-642 - Support Flink Detached Mode for JOB execution
FlinkRunner gives exception when job is submitted in detached mode.
Following code will throw exception:
{code}
LOG.info("Execution finished in {} msecs", result.getNetRuntime());
{code}
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sumitchawla/incubator-beam master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/974.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #974
commit 25482cc32fb04965b055d9ab376095d75e10080b
Author: Sumit Chawla
Date: 2016-09-19T22:10:53Z
BEAM-642 - Support Flink Detached Mode for JOB execution
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Amit Sela
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {code}
> LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (BEAM-642) FlinkRunner does not support Detached Mode
[
https://issues.apache.org/jira/browse/BEAM-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504842#comment-15504842
]
Sumit Chawla commented on BEAM-642:
---
Can somebody please assign this issue to me?
> FlinkRunner does not support Detached Mode
> --
>
> Key: BEAM-642
> URL: https://issues.apache.org/jira/browse/BEAM-642
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Sumit Chawla
>Assignee: Amit Sela
>
> FlinkRunner gives exception when job is submitted in detached mode.
> Following code will throw exception:
> {{ LOG.info("Execution finished in {} msecs", result.getNetRuntime());
> }}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
