LIBPROCESS_IP is the IP address that you want the scheduler (driver) to bind to. It has nothing to do with the ZooKeeper address.
In other words, do export LIBPROCESS_IP=scheduler_ip_address On Tue, Jul 28, 2015 at 2:00 PM, Haripriya Ayyalasomayajula < [email protected]> wrote: > I am trying to do this > > export LIBPROCESS_IP=zk://my_ipaddress:2181/mesos > > ./bin/spark-shell > > It gives me this error and aborts > > WARNING: Logging before InitGoogleLogging() is written to STDERR > > F0728 15:43:39.361445 13209 process.cpp:847] Parsing > LIBPROCESS_IP=zk://my_ipaddress:2181/ failed: Failed to parse the IP > > On Tue, Jul 28, 2015 at 1:51 PM, Tim Chen <[email protected]> wrote: > >> spark-env.sh works as it will be called by spark-submit/spark-shell, or >> you can just set it before you call spark-shell yourself. >> >> Tim >> >> On Tue, Jul 28, 2015 at 1:43 PM, Haripriya Ayyalasomayajula < >> [email protected]> wrote: >> >>> Hi, >>> >>> Where can I set the libprocess_ip env variable? spark_env.sh? Thats the >>> only place I can think of. Can you please point me to any related >>> documentation? >>> >>> On Tue, Jul 28, 2015 at 12:46 PM, Nikolaos Ballas neXus < >>> [email protected]> wrote: >>> >>>> If you are not using any dns like service under /etc/mesos-master/ >>>> create two files called ip and hostname and put the ip of the eth >>>> interface. >>>> >>>> >>>> >>>> Sent from my Samsung device >>>> >>>> >>>> -------- Original message -------- >>>> From: Haripriya Ayyalasomayajula <[email protected]> >>>> Date: 28/07/2015 20:18 (GMT+01:00) >>>> To: [email protected] >>>> Subject: Problems connecting with Mesos Master >>>> >>>> Hi all, >>>> >>>> I am trying to use Spark 1.4.1 with Mesos 0.23.0. >>>> >>>> When I try to start my spark-shell, it gives me the following warning >>>> : >>>> >>>> ************************************************** >>>> >>>> Scheduler driver bound to loopback interface! Cannot communicate with >>>> remote master(s). You might want to set 'LIBPROCESS_IP' environment >>>> variable to use a routable IP address. >>>> --- >>>> >>>> Spark-shell works fine on the node where I run master, but if I start >>>> running on any of the other slave nodes it gives me the following error: >>>> >>>> E0728 11:22:53.176515 10503 socket.hpp:107] Shutdown failed on fd=6: >>>> Transport endpoint is not connected [107] >>>> >>>> E0728 11:22:53.210146 10503 socket.hpp:107] Shutdown failed on fd=6: >>>> Transport endpoint is not connected [107] >>>> >>>> I have the following configs: >>>> >>>> >>>> - zookeeper configured to the mesos master >>>> - /etc/mesos/zk on all nodes pointing to mesos master ip. >>>> >>>> I am not sure if I have to set the ip flag and where I have to set >>>> the --ip flag? >>>> >>>> -- >>>> Regards, >>>> Haripriya Ayyalasomayajula >>>> >>>> >>> >>> >>> -- >>> Regards, >>> Haripriya Ayyalasomayajula >>> >>> >> > > > -- > Regards, > Haripriya Ayyalasomayajula > >
