Re: protobuf error running spark on hadoop 2.4

2014-12-16 Thread RodrigoB
Hi, I'm currently having this issue as well, while using Spark with Akka 2.3.4. Did Debasish's suggestion work for you? I've already built Spark with hadoop 2.3.0 but still having the error. tnks, Rod -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/prot

Re: protobuf error running spark on hadoop 2.4

2014-10-08 Thread Debasish Das
I have faced this in the past and I have to put a profile -Phadoop2.3... mvn -Dhadoop.version=2.3.0-cdh5.1.0 -Phadoop-2.3 -Pyarn -DskipTests install On Wed, Oct 8, 2014 at 1:40 PM, Chuang Liu wrote: > Hi: > > I tried to build Spark (1.1.0) with hadoop 2.4.0, and ran a simple > wordcount example

protobuf error running spark on hadoop 2.4

2014-10-08 Thread Chuang Liu
Hi: I tried to build Spark (1.1.0) with hadoop 2.4.0, and ran a simple wordcount example using spark_shell on mesos. When I ran my application, I got following error that looks related to the mismatch of protobuf versions between hadoop cluster (protobuf 2.5) and spark (protobuf 4.1). I ran "mvn d