I am trying to do this export LIBPROCESS_IP=zk://my_ipaddress:2181/mesos
./bin/spark-shell It gives me this error and aborts WARNING: Logging before InitGoogleLogging() is written to STDERR F0728 15:43:39.361445 13209 process.cpp:847] Parsing LIBPROCESS_IP=zk://my_ipaddress:2181/ failed: Failed to parse the IP On Tue, Jul 28, 2015 at 1:51 PM, Tim Chen <[email protected]> wrote: > spark-env.sh works as it will be called by spark-submit/spark-shell, or > you can just set it before you call spark-shell yourself. > > Tim > > On Tue, Jul 28, 2015 at 1:43 PM, Haripriya Ayyalasomayajula < > [email protected]> wrote: > >> Hi, >> >> Where can I set the libprocess_ip env variable? spark_env.sh? Thats the >> only place I can think of. Can you please point me to any related >> documentation? >> >> On Tue, Jul 28, 2015 at 12:46 PM, Nikolaos Ballas neXus < >> [email protected]> wrote: >> >>> If you are not using any dns like service under /etc/mesos-master/ >>> create two files called ip and hostname and put the ip of the eth >>> interface. >>> >>> >>> >>> Sent from my Samsung device >>> >>> >>> -------- Original message -------- >>> From: Haripriya Ayyalasomayajula <[email protected]> >>> Date: 28/07/2015 20:18 (GMT+01:00) >>> To: [email protected] >>> Subject: Problems connecting with Mesos Master >>> >>> Hi all, >>> >>> I am trying to use Spark 1.4.1 with Mesos 0.23.0. >>> >>> When I try to start my spark-shell, it gives me the following warning : >>> >>> ************************************************** >>> >>> Scheduler driver bound to loopback interface! Cannot communicate with >>> remote master(s). You might want to set 'LIBPROCESS_IP' environment >>> variable to use a routable IP address. >>> --- >>> >>> Spark-shell works fine on the node where I run master, but if I start >>> running on any of the other slave nodes it gives me the following error: >>> >>> E0728 11:22:53.176515 10503 socket.hpp:107] Shutdown failed on fd=6: >>> Transport endpoint is not connected [107] >>> >>> E0728 11:22:53.210146 10503 socket.hpp:107] Shutdown failed on fd=6: >>> Transport endpoint is not connected [107] >>> >>> I have the following configs: >>> >>> >>> - zookeeper configured to the mesos master >>> - /etc/mesos/zk on all nodes pointing to mesos master ip. >>> >>> I am not sure if I have to set the ip flag and where I have to set the >>> --ip flag? >>> >>> -- >>> Regards, >>> Haripriya Ayyalasomayajula >>> >>> >> >> >> -- >> Regards, >> Haripriya Ayyalasomayajula >> >> > -- Regards, Haripriya Ayyalasomayajula
