Hello,

I have some problems with Hive on spark.

I'm using spark branch with a standalone spark cluster but I can't make any
query.

I have this error :  java.lang.ClassCastException:
com.esotericsoftware.kryo.Kryo cannot be cast to
org.apache.hive.com.esotericsoftware.kryo.Kryo

I wander if it's because Kryo is shaded in HIVE jars.

Any advice to understand what's going on?

Thanks in advance for any help.

Regards,

Here the complete stack :

2015-01-13 10:55:06,604 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) - java.lang.ClassCastException:
com.esotericsoftware.kryo.Kryo cannot be cast to
org.apache.hive.com.esotericsoftware.kryo.Kryo
2015-01-13 10:55:06,604 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
org.apache.hadoop.hive.ql.exec.spark.KryoSerializer.deserialize(KryoSerializer.java:49)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:211)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:298)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:269)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
java.util.concurrent.FutureTask.run(FutureTask.java:262)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
2015-01-13 10:55:06,605 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
2015-01-13 10:55:06,606 INFO  [stderr-redir-1]: client.SparkClientImpl
(SparkClientImpl.java:run(454)) -        at
java.lang.Thread.run(Thread.java:744)



Damien CAROL

   - tél : +33 (0)4 74 96 88 14
   - email : dca...@blitzbs.com

BLITZ BUSINESS SERVICE

Reply via email to