Thanks a lot Jacob
On 2/23/11 22:52, Dmitriy Ryaboy wrote:
Hi Byambaa,
Since the CDH3B4 just came out, we haven't really had a chance to play with
it; I know that Cloudera applies some of their own packaging magic to Pig,
but don't know what all they did and which jars they put in -- please ask
them either on freenode #cloudera channel, or their user list (
https://groups.google.com/a/cloudera.org/group/cdh-user/).
Let us know how it goes!
D
On Wed, Feb 23, 2011 at 4:53 AM, Jacob Perkins<[email protected]>wrote:
Had this. It's because Pig packages the Hadoop 0.20 classes into its
jar. Tail the namenode logs when you run the Pig shell and you'll see an
error about version. Try the instructions here:
http://thedatachef.blogspot.com/2011/01/apache-pig-08-with-cloudera-cdh3.html
--jacob
@thedatachef
On Wed, 2011-02-23 at 13:45 +0100, byambajargal wrote:
Hello everyone
I am using CDH3 Beta 4 distribution on 11 node cluster machines.
I successfully installed Hadoop. However, Pig seems to be giving us some
trouble. I installed Pig according to the instructions here (for Red
Hat): https://docs.cloudera.com/display/DOC/Pig+Installation, and it
will install successfully.
However, when I start the grunt shell, i have got a error message
Unexpected internal error. Failed to create DataStorage". and in pig log
file
Error before Pig is launched
----------------------------
ERROR 2999: Unexpected internal error. Failed to create DataStorage
java.lang.RuntimeException: Failed to create DataStorage
at
org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
at
org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:213)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:133)
at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
at org.apache.pig.PigServer.<init>(PigServer.java:225)
at org.apache.pig.PigServer.<init>(PigServer.java:214)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55)
at org.apache.pig.Main.run(Main.java:462)
at org.apache.pig.Main.main(Main.java:107)
Caused by: org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client
= 63, server = 61)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:403)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
at
org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
I installed Cloudera Hadoop version 0.20.2+737in on cluster
mode<https://docs.cloudera.com/display/DOC/CDH3+Deployment+on+a+Cluster>,
so
Pig is compatible.
thanks
Byambaa
