[ https://issues.apache.org/jira/browse/HIVE-24426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ayush Saxena reassigned HIVE-24426: ----------------------------------- > Spark job fails with fixed umbilical server port > ------------------------------------------------ > > Key: HIVE-24426 > URL: https://issues.apache.org/jira/browse/HIVE-24426 > Project: Hive > Issue Type: Bug > Reporter: Ayush Saxena > Assignee: Ayush Saxena > Priority: Critical > > In case of cloud deployments, multiple executors are launched on name node, > and incase a fixed umbilical port is specified using > {{spark.hadoop.hive.llap.daemon.umbilical.port=30006}} > The job fails with BindException. > {noformat} > Caused by: java.net.BindException: Problem binding to [0.0.0.0:30006] > java.net.BindException: Address already in use; For more details see: > http://wiki.apache.org/hadoop/BindException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:840) > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:741) > at org.apache.hadoop.ipc.Server.bind(Server.java:605) > at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:1169) > at org.apache.hadoop.ipc.Server.<init>(Server.java:3032) > at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:1039) > at > org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:438) > at > org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:332) > at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848) > at > org.apache.hadoop.hive.llap.tezplugins.helpers.LlapTaskUmbilicalServer.<init>(LlapTaskUmbilicalServer.java:67) > at > org.apache.hadoop.hive.llap.ext.LlapTaskUmbilicalExternalClient$SharedUmbilicalServer.<init>(LlapTaskUmbilicalExternalClient.java:122) > ... 26 more > Caused by: java.net.BindException: Address already in use > at sun.nio.ch.Net.bind0(Native Method) > at sun.nio.ch.Net.bind(Net.java:433) > at sun.nio.ch.Net.bind(Net.java:425) > at > sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220) > at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85) > at org.apache.hadoop.ipc.Server.bind(Server.java:588) > ... 34 more{noformat} > To counter this, better to provide a range of ports -- This message was sent by Atlassian Jira (v8.3.4#803005)