My spark program just hang there after mesos saw many task failures. I read an earlier post https://groups.google.com/forum/#!msg/spark-users/RThPAN-5zX8/vuxXp27P5-MJ
which says that we should set mesos's failover_timeout, otherwise mesos would have a rather long default failover timeout. But in mesos 0.18.1 this mesos master option seems gone. How can I set this option when submitting spark job to mesos? Or do I still need to set this option? If not, what should I do when spark hangs and mesos is waiting, for something? More logs are here: https://github.com/datastax/spark-cassandra-connector/issues/134 And the spark log looks like (ignore the date, I copied from elsewhere) 12/03/17 16:03:46 INFO spark.MesosScheduler: Parents of final stage: List() 12/03/17 16:03:46 INFO spark.MesosScheduler: Missing parents: List() 12/03/17 16:03:46 INFO spark.MesosScheduler: Submitting Stage 0, which has no missing parents
