Stavros, Spark does not support this. I am currently in the process of submitting patches for it however it first has to pass through the legal team at the company I work for.
Kind regards, Radek Gruchalski [email protected] (mailto:[email protected]) (mailto:[email protected]) de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruchalski/) Confidentiality: This communication is intended for the above-named person and may be confidential and/or legally privileged. If it has come to you in error you must take no action based on it, nor must you copy or show it to anyone; please delete/destroy and inform the sender immediately. On Thursday, 22 October 2015 at 21:08, Stavros Kontopoulos wrote: > Bridge... with the latest mesos library vesion 0.25... > > On Thu, Oct 22, 2015 at 9:07 PM, Elizabeth Lingg <[email protected] > (mailto:[email protected])> wrote: > > Are you using Bridge or Host Networking? > > > > -Elizabeth > > > > > > > > On Thu, Oct 22, 2015 at 12:02 PM, Stavros Kontopoulos > > <[email protected] (mailto:[email protected])> wrote: > > > Hi, > > > > > > Im using spark on mesos on docker. I have linked my slaves to the master > > > and a > > > spark repl works fine inside the master container. > > > > > > If i try to crate the same spark repl form the host i get stuck at the > > > point when the framework tries to register to the mesos master (here the > > > framework is the spark repl itself). > > > I can ping the container from my host and vice versa. So networking its > > > not the problem. > > > What i noticed form the logs is that mesos does not resolve the correct > > > ip: > > > > > > Framework failover timeout, removing framework > > > b3605c33-f573-4d40-806f-b9b0abee2e32-0012 (Spark shell) at > > > [email protected]:40186 > > > (http://[email protected]:40186) > > > > > > docker0 interface is on 172.17.x.x and my host is one such ip so i didnt > > > expect there to see > > > 127.0.1.1. I have tried several things like spark.driver.host, > > > SPARK_LOCAL_IP to be set correctly but with no result... > > > I suspect this is a mesos problem on docker... > > > > > > Thnx, > > > > > > S. > > >
