MESOS slaves shut down due to 'health check timed out

2014-11-07 Thread Yangcheng Huang
Hi guys Do you know how to handle the following case - = From MESOS log file = Slave asked to shut down by master@:5050 because 'health check timed out' I1107 17:33:20.860988 27573 slave.cpp:1337] Asked to shut down framework === Any configurations

Any limitations of spark.shuffle.spill?

2014-11-05 Thread Yangcheng Huang
Hi One question about the power of spark.shuffle.spill - (I know this has been asked several times :-) Basically, in handling a (cached) dataset that doesn't fit in memory, Spark can spill it to disk. However, can I say that, when this is enabled, Spark can handle the situation faultlessly,

RE: Spark on Mesos Issue - Do I need to install Spark on Mesos slaves

2014-10-10 Thread Yangcheng Huang
spark-defaults.conf spark.executor.uri hdfs://:9000/user//spark-1.1.0-bin-hadoop2.4.tgz From: Bijoy Deb [mailto:bijoy.comput...@gmail.com] Sent: den 10 oktober 2014 11:59 To: user@spark.apache.org Subject: Spark on Mesos Issue - Do I need to install Spark on Mesos slaves Hi, I