Re: spark on mesos with docker issue

Stavros, As mentioned a couple of weeks ago: https://issues.apache.org/jira/browse/SPARK-11638 Happy to answer any questions. Kind regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/

spark on mesos with docker issue

Hi, Im using spark on mesos on docker. I have linked my slaves to the master and a spark repl works fine inside the master container. If i try to crate the same spark repl form the host i get stuck at the point when the framework tries to register to the mesos master (here the framework is the

Re: spark on mesos with docker issue

Thnx Rad, sounds pretty cool :). Elizabeth one note for the jira ticket i do not run the cluster with zookeeper, i use mesos master in stand alone mode... i guess it makes no difference right? On Thu, Oct 22, 2015 at 10:38 PM, Rad Gruchalski wrote: > There are 2 things: >

Re: spark on mesos with docker issue

On Thu, Oct 22, 2015 at 9:10 PM, Rad Gruchalski wrote: > Stavros, > > Spark does not support this. I am currently in the process of submitting > patches for it however it first has to pass through the legal team at the > company I work for. > What exactly is missing in

Re: spark on mesos with docker issue

Right, this issue is related to the advertising the hostname / port in libprocess that is reachable by the Mesos Master. It should not be related to the Mesos Master running in Standalone (non HA) mode and not using Zookeeper. -Elizabeth On Thu, Oct 22, 2015 at 1:45 PM, Stavros Kontopoulos <

Re: spark on mesos with docker issue

There are 2 things: - Akka remote in 2.3.x does not support advertising hostname / port different to what it binds to - All other services: file server, broadcast server, repl class server do not support advertising hostnames / ports different than what they bind to Just to expand on the