Re: java.lang.ClassNotFoundException - spark on mesos

2014-05-02 Thread bo...@shopify.com
I have opened a PR for discussion on the apache/spark repository https://github.com/apache/spark/pull/620 There is certainly a classLoader problem in the way Mesos and Spark operate, I'm not sure what caused it to suddenly stop working so I'd like to open the discussion there -- View this messa

Re: java.lang.ClassNotFoundException - spark on mesos

2014-04-02 Thread Bharath Bhushan
I tried several things in order to get 1.0.0 git tree to work with mesos. All my efforts failed. I could run spark 0.9.0 on mesos but not spark 1.0.0. Please suggest any other things I can try. 1. Change project/SparkBuild.scala to use mesos 0.17.0 and then make_distribution.sh. 2. Try build

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan
Another problem I noticed is that the current 1.0.0 git tree still gives me the ClassNotFoundException. I see that the SPARK-1052 is already fixed there. I then modified the pom.xml for mesos and protobuf and that still gave the ClassNotFoundException. I also tried modifying pom.xml only for mes

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan
I was talking about the protobuf version issue as not fixed. I could not find any reference to the problem or the fix. Reg. SPARK-1052, I could pull in the fix into my 0.9.0 tree (from the tar ball on the website) and I see the fix in the latest git. Thanks On 01-Apr-2014, at 3:28 am, deric w

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread deric
Which repository do you use? The issue should be fixed in 0.9.1 and 1.0.0 https://spark-project.atlassian.net/browse/SPARK-1052 There's an old repository https://github.com/apache/incubator-spark and as Spark become one of top level pr

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan
l Message - >> From: "Bharath Bhushan" >> To: user@spark.apache.org >> Sent: Monday, March 31, 2014 9:46:32 AM >> Subject: Re: java.lang.ClassNotFoundException - spark on mesos >> >> I tried 0.9.0 and the latest git tree of spark. For mesos, I tried

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Tim St Clair
, March 31, 2014 9:46:32 AM > Subject: Re: java.lang.ClassNotFoundException - spark on mesos > > I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and > the latest git tree. > > Thanks > > > On 31-Mar-2014, at 7:24 pm, Tim St Clair wrote: > >

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan
; Cheers, > Tim > > - Original Message - >> From: "Bharath Bhushan" >> To: user@spark.apache.org >> Sent: Monday, March 31, 2014 8:16:19 AM >> Subject: java.lang.ClassNotFoundException - spark on mesos >> >> I am facing different kinds of java

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Tim St Clair
What versions are you running? There is a known protobuf 2.5 mismatch, depending on your versions. Cheers, Tim - Original Message - > From: "Bharath Bhushan" > To: user@spark.apache.org > Sent: Monday, March 31, 2014 8:16:19 AM > Subject: java.lang.ClassNotFou

java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan
I am facing different kinds of java.lang.ClassNotFoundException when trying to run spark on mesos. One error has to do with org.apache.spark.executor.MesosExecutorBackend. Another has to do with org.apache.spark.serializer.JavaSerializer. I see other people complaining about similar issues. I