Github user darose commented on the pull request:
https://github.com/apache/spark/pull/629#issuecomment-42602116
I tried building an running this code, but it failed with:
14/05/08 20:09:11 ERROR Remoting:
org.apache.spark.deploy.ApplicationDescription; local class incompatible:
stream classdesc serialVersionUID = -6451051318873184044, local class
serialVersionUID = 5837456792360$
1411
java.io.InvalidClassException:
org.apache.spark.deploy.ApplicationDescription; local class incompatible:
stream classdesc serialVersionUID = -6451051318873184044, local class
serialVersionUID = 5837456792360714$
1
at
java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:617)
at
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1622)
at
java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
at
akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136)
...
* I grabbed the source zip from
https://github.com/apache/spark/tree/73b0cbcc241cca3d318ff74340e80b02f884acbd
* I built it with "SPARK_HADOOP_VERSION=2.3.0-cdh5.0.0 SPARK_YARN=true
sbt/sbt assembly" followed by "SPARK_HADOOP_VERSION=2.3.0-cdh5.0.0
SPARK_YARN=true sbt/sbt package"
* I grabbed shark 0.9.1 source and built it with
"SHARK_HADOOP_VERSION=2.3.0-cdh5.0.0 ./sbt/sbt assembly" and
"SHARK_HADOOP_VERSION=2.3.0-cdh5.0.0 ./sbt/sbt package"
* I deployed both to a client, a master, and a worker machine
Master and worker can talk to each other, worker can register with master.
I can launch a shark shell on the client, and do basic things like "show
tables". But when I try a simple SELECT query, I get the above error.
Any idea what I'm doing wrong?
Any idea what I might be doing wrong?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
