[ https://issues.apache.org/jira/browse/FLINK-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120871#comment-17120871 ]
Jeff Zhang commented on FLINK-17788: ------------------------------------ [~kkl0u] The second yarn app fail to launch due to port conflict, here's what I see. But anyway, scala shell should not launch another yarn app, instead it should use only one yarn session cluster. {code} 2020-06-01 17:09:18,860 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting YarnJobClusterEntrypoint down with application status FAILED. Diagnostics org.apache.flink.util.FlinkException: Could not create the DispatcherResourceManagerComponent. at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:255) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:216) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:169) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:168) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:516) at org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:89) Caused by: java.net.BindException: Could not start rest endpoint on any port in port range 57574 at org.apache.flink.runtime.rest.RestServerEndpoint.start(RestServerEndpoint.java:222) at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:163) ... 9 more {code} > scala shell in yarn mode is broken > ---------------------------------- > > Key: FLINK-17788 > URL: https://issues.apache.org/jira/browse/FLINK-17788 > Project: Flink > Issue Type: Bug > Components: Scala Shell > Affects Versions: 1.11.0 > Reporter: Jeff Zhang > Priority: Major > Labels: pull-request-available > > When I start scala shell in yarn mode, one yarn app will be launched, and > after I write some flink code and trigger a flink job, another yarn app will > be launched but would failed to launch due to some conflicts. -- This message was sent by Atlassian Jira (v8.3.4#803005)