Re: Problems running Spark job on mesos in fine-grained mode

2014-06-24 Thread Mayur Rustagi
Hi Sebastien, Are you using Pyspark by any chance, is that working for you (post the patch?) Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi https://twitter.com/mayur_rustagi On Mon, Jun 23, 2014 at 1:51 PM, Fedechicco fedechi...@gmail.com wrote: I'm

Re: Problems running Spark job on mesos in fine-grained mode

2014-06-24 Thread Sébastien Rainville
Hi Mayur, I use primarily Scala, but I tested with pyspark, and it's working fine too post the patch. Thanks, - Sebastien On Tue, Jun 24, 2014 at 6:08 PM, Mayur Rustagi mayur.rust...@gmail.com wrote: Hi Sebastien, Are you using Pyspark by any chance, is that working for you (post the

Re: Problems running Spark job on mesos in fine-grained mode

2014-06-23 Thread Fedechicco
I'm getting the same behavior and it's crucial I get it fixed for an evaluation of Spark + Mesos within my company. I'm bumping +1 for the request of putting this fix in the 1.0.1 if possible! thanks, Federico 2014-06-20 20:51 GMT+02:00 Sébastien Rainville sebastienrainvi...@gmail.com : Hi,

Re: Problems running Spark job on mesos in fine-grained mode

2014-06-20 Thread Sébastien Rainville
Hi, this is just a follow-up regarding this issue. Turns out that it's caused by a bug in Spark. I created a case for it: https://issues.apache.org/jira/browse/SPARK-2204 and submitted a patch. Any chance this could be included in the 1.0.1 release? Thanks, - Sebastien On Tue, Jun 17, 2014

Problems running Spark job on mesos in fine-grained mode

2014-06-17 Thread Sébastien Rainville
Hi, I'm having trouble running spark on mesos in fine-grained mode. I'm running spark 1.0.0 and mesos 0.18.0. The tasks are failing randomly, which most of the time, but not always, cause the job to fail. The same code is running fine in coarse-grained mode. I see the following exceptions in the