I tried to start the Spark Worker using the registered IP but this error
occurred:
15/04/13 21:35:59 INFO Worker: Registered signal handlers for [TERM, HUP,
INT]
Exception in thread "main" java.net.UnknownHostException: 10.240.92.75/:
Name or service not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
at
java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
at java.net.InetAddress.getAllByName0(InetAddress.java:1246)
at java.net.InetAddress.getAllByName(InetAddress.java:1162)
at java.net.InetAddress.getAllByName(InetAddress.java:1098)
at java.net.InetAddress.getByName(InetAddress.java:1048)
at org.apache.spark.util.Utils$.getAddressHostName(Utils.scala:819)
at
org.apache.spark.util.Utils$.localIpAddressHostname$lzycompute(Utils.scala:763)
at org.apache.spark.util.Utils$.localIpAddressHostname(Utils.scala:763)
at
org.apache.spark.util.Utils$$anonfun$localHostName$1.apply(Utils.scala:815)
at
org.apache.spark.util.Utils$$anonfun$localHostName$1.apply(Utils.scala:815)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.util.Utils$.localHostName(Utils.scala:815)
at
org.apache.spark.deploy.worker.WorkerArguments.<init>(WorkerArguments.scala:29)
at org.apache.spark.deploy.worker.Worker$.main(Worker.scala:528)
at org.apache.spark.deploy.worker.Worker.main(Worker.scala)
My concern is that I have deployed the Spark Master using the same process
(assigning the corresponding IP) and everything works fine. I have also
looked at the /etc/hosts file and the 10.240.92.75 is up and working fine.
Moreover I have changed the ipv6 to ipv4 using _JAVA_OPTIONS:
-Djava.net.preferIPv4Stack=true but still the error was keep coming up. I am
a little bit confused; I would be grateful for any suggestions/help.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Worker-IP-Error-tp22484.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]