[
https://issues.apache.org/jira/browse/FLINK-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120871#comment-17120871
]
Jeff Zhang commented on FLINK-17788:
------------------------------------
[~kkl0u] The second yarn app fail to launch due to port conflict, here's what I
see. But anyway, scala shell should not launch another yarn app, instead it
should use only one yarn session cluster.
{code}
2020-06-01 17:09:18,860 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting
YarnJobClusterEntrypoint down with application status FAILED. Diagnostics
org.apache.flink.util.FlinkException: Could not create the
DispatcherResourceManagerComponent.
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:255)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:216)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:169)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:168)
at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:516)
at
org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:89)
Caused by: java.net.BindException: Could not start rest endpoint on any port in
port range 57574
at
org.apache.flink.runtime.rest.RestServerEndpoint.start(RestServerEndpoint.java:222)
at
org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:163)
... 9 more
{code}
> scala shell in yarn mode is broken
> ----------------------------------
>
> Key: FLINK-17788
> URL: https://issues.apache.org/jira/browse/FLINK-17788
> Project: Flink
> Issue Type: Bug
> Components: Scala Shell
> Affects Versions: 1.11.0
> Reporter: Jeff Zhang
> Priority: Major
> Labels: pull-request-available
>
> When I start scala shell in yarn mode, one yarn app will be launched, and
> after I write some flink code and trigger a flink job, another yarn app will
> be launched but would failed to launch due to some conflicts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
