[
https://issues.apache.org/jira/browse/HIVE-24426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ayush Saxena updated HIVE-24426:
--------------------------------
Parent: HIVE-24058
Issue Type: Sub-task (was: Bug)
> Spark job fails with fixed LlapTaskUmbilicalServer port
> -------------------------------------------------------
>
> Key: HIVE-24426
> URL: https://issues.apache.org/jira/browse/HIVE-24426
> Project: Hive
> Issue Type: Sub-task
> Reporter: Ayush Saxena
> Assignee: Ayush Saxena
> Priority: Critical
>
> In case of cloud deployments, multiple executors are launched on name node,
> and incase a fixed umbilical port is specified using
> {{spark.hadoop.hive.llap.daemon.umbilical.port=30006}}
> The job fails with BindException.
> {noformat}
> Caused by: java.net.BindException: Problem binding to [0.0.0.0:30006]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:840)
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:741)
> at org.apache.hadoop.ipc.Server.bind(Server.java:605)
> at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:1169)
> at org.apache.hadoop.ipc.Server.<init>(Server.java:3032)
> at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:1039)
> at
> org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:438)
> at
> org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:332)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848)
> at
> org.apache.hadoop.hive.llap.tezplugins.helpers.LlapTaskUmbilicalServer.<init>(LlapTaskUmbilicalServer.java:67)
> at
> org.apache.hadoop.hive.llap.ext.LlapTaskUmbilicalExternalClient$SharedUmbilicalServer.<init>(LlapTaskUmbilicalExternalClient.java:122)
> ... 26 more
> Caused by: java.net.BindException: Address already in use
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:433)
> at sun.nio.ch.Net.bind(Net.java:425)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
> at org.apache.hadoop.ipc.Server.bind(Server.java:588)
> ... 34 more{noformat}
> To counter this, better to provide a range of ports
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
