So, still not working but playing around with some conf variables, I have a new error now...
When I set the spark.driver.host and spark.driver.port variables in my spark-env.sh, I have the following error. The weird part is that when I go to the Spark homepage, and look at the environment, the spark.httpBroadcast.uri is set...:S I ll keep digging...:D 14/02/07 09:42:37 INFO MesosExecutorBackend: Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 14/02/07 09:42:37 INFO MesosExecutorBackend: Registered with Mesos as executor ID 201402041543-2365590026-5050-17047-3 14/02/07 09:42:37 INFO Slf4jLogger: Slf4jLogger started 14/02/07 09:42:37 INFO Remoting: Starting remoting 14/02/07 09:42:38 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://[email protected]:40872] 14/02/07 09:42:38 INFO Remoting: Remoting now listens on addresses: [akka.tcp://[email protected]:40872] 14/02/07 09:42:38 INFO SparkEnv: Connecting to BlockManagerMaster: akka.tcp://[email protected]:38700/user/BlockManagerMaster 14/02/07 09:42:38 INFO DiskBlockManager: Created local directory at /tmp/spark-local-20140207094238-2712 14/02/07 09:42:38 INFO MemoryStore: MemoryStore started with capacity 8.6 GB. 14/02/07 09:42:38 INFO ConnectionManager: Bound socket to port 47228 with id = ConnectionManagerId(srv-esx-isc04.crpgl.lu,47228) 14/02/07 09:42:38 INFO BlockManagerMaster: Trying to register BlockManager 14/02/07 09:42:38 INFO BlockManagerMaster: Registered BlockManager java.util.NoSuchElementException: spark.httpBroadcast.uri at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:151) at org.apache.spark.SparkConf$$anonfun$get$1.apply(SparkConf.scala:151) at scala.collection.MapLike$class.getOrElse(MapLike.scala:128) at scala.collection.AbstractMap.getOrElse(Map.scala:58) at org.apache.spark.SparkConf.get(SparkConf.scala:151) at org.apache.spark.broadcast.HttpBroadcast$.initialize(HttpBroadcast.scala:104) at org.apache.spark.broadcast.HttpBroadcastFactory.initialize(HttpBroadcast.scala:70) at org.apache.spark.broadcast.BroadcastManager.initialize(Broadcast.scala:81) at org.apache.spark.broadcast.BroadcastManager.<init>(Broadcast.scala:68) at org.apache.spark.SparkEnv$.create(SparkEnv.scala:176) at org.apache.spark.executor.Executor.<init>(Executor.scala:110) at org.apache.spark.executor.MesosExecutorBackend.registered(MesosExecutorBackend.scala:58) Exception in thread "Thread-0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-0-9-0-on-top-of-Mesos-error-Akka-Actor-not-found-tp1164p1303.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
