Hi,
My shark-env.sh is already pointing to the hadoop2 cluster:
export
HADOOP_HOME=/opt/cloudera/parcels/CDH-4.6.0-1.cdh4.6.0.p0.26/lib/hadoop
Both the hadoop cluster as well as the embedded hadoop jars within Shark
are of version 2.0.0.
Any more suggestions please?
Thanks
On Wed, May 28, 2014 at 11:00 PM, Andrew Ash and...@andrewash.com wrote:
IPC version 7 vs 4 is Hadoop2 vs Hadoop1. I'm guessing your Hadoop
cluster is on a different version than the .jars you're using in Shark.
http://stackoverflow.com/questions/16491547/pig-to-hadoop-issue-server-ipc-version-7-cannot-communicate-with-client-version
Can you try finding matching jars for your Hadoop cluster?
On Wed, May 28, 2014 at 8:47 AM, bijoy deb bijoy.comput...@gmail.comwrote:
Hi all,
I have installed Apache Shark 0.9.1 on my machine which comes bundled
with hive-0.11 version of hive jars.I am trying to integrate this with my
pre-existing CDH-4.6 version of the Hive server which is of version 0.10.On
pointing HIVE_HOME in spark-env.sh to the cloudera version of the hive
(hive-0.10),I am getting the IPC version mismatch error as below when I try
to execute any SELECT query on an existing Hive table:
shark select * from test_table;
27.828: [Full GC 61270K-21300K(1013632K), 0.1185540 secs]
java.lang.RuntimeException: Server IPC version 7 cannot communicate with
client version 4
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1362)
It seems the Shark-0.9.1 version is incompatible with Hive-0.10
server.Please suggest a solution if anyone has encountered this issue.
Thanks
Bijoy
