0.21.0-pre Spark latest

2014-10-28 Thread Tim St Clair
Folks - We have some automated tests that run the latest Mesos against the latest Spark, and we've run across a series of issues in both fine, and course grained mode that I believe stem from a series of changes in the 0.21 cycle. I'm not certain if anyone owns this integration, but we

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Brenden Matthews
Since we've recently adopted Spark, I'll second Tim's comment. We had an issue with 0.20.1 that was possibly related to Spark[1], so it's important for us to get this stuff fixed in 0.21.0. Tim, can you elaborate on the issues you saw? Have you tested with my recent Spark patches[2][3]? [1]:

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Tim St Clair
-pre Spark latest Since we've recently adopted Spark, I'll second Tim's comment. We had an issue with 0.20.1 that was possibly related to Spark[1], so it's important for us to get this stuff fixed in 0.21.0. Tim, can you elaborate on the issues you saw? Have you tested with my recent Spark

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Timothy Chen
...@mesos.apache.org Cc: mesos-devel dev@mesos.apache.org, RJ Nowling rnowl...@redhat.com, Erik Erlandson e...@redhat.com Sent: Tuesday, October 28, 2014 9:51:58 AM Subject: Re: 0.21.0-pre Spark latest Since we've recently adopted Spark, I'll second Tim's comment. We had an issue

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Timothy Chen
Subject: Re: 0.21.0-pre Spark latest Hi Tim, Thanks for doing the integration tests, that's something that I wanted to do but never got to yet. I have great interest ensuring spark and mesos work, and I know Brenden as well does. I have been tracking these spark mesos problems with spark jira