Hi Byambaa, Since the CDH3B4 just came out, we haven't really had a chance to play with it; I know that Cloudera applies some of their own packaging magic to Pig, but don't know what all they did and which jars they put in -- please ask them either on freenode #cloudera channel, or their user list ( https://groups.google.com/a/cloudera.org/group/cdh-user/). Let us know how it goes!
D On Wed, Feb 23, 2011 at 4:53 AM, Jacob Perkins <[email protected]>wrote: > Had this. It's because Pig packages the Hadoop 0.20 classes into its > jar. Tail the namenode logs when you run the Pig shell and you'll see an > error about version. Try the instructions here: > > > http://thedatachef.blogspot.com/2011/01/apache-pig-08-with-cloudera-cdh3.html > > --jacob > @thedatachef > > On Wed, 2011-02-23 at 13:45 +0100, byambajargal wrote: > > Hello everyone > > > > I am using CDH3 Beta 4 distribution on 11 node cluster machines. > > > > > > > > I successfully installed Hadoop. However, Pig seems to be giving us some > > trouble. I installed Pig according to the instructions here (for Red > > Hat): https://docs.cloudera.com/display/DOC/Pig+Installation, and it > > will install successfully. > > > > However, when I start the grunt shell, i have got a error message > > Unexpected internal error. Failed to create DataStorage". and in pig log > > file > > > > Error before Pig is launched > > ---------------------------- > > ERROR 2999: Unexpected internal error. Failed to create DataStorage > > > > java.lang.RuntimeException: Failed to create DataStorage > > at > > > org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75) > > at > > > org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58) > > at > > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:213) > > at > > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:133) > > at org.apache.pig.impl.PigContext.connect(PigContext.java:183) > > at org.apache.pig.PigServer.<init>(PigServer.java:225) > > at org.apache.pig.PigServer.<init>(PigServer.java:214) > > at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55) > > at org.apache.pig.Main.run(Main.java:462) > > at org.apache.pig.Main.main(Main.java:107) > > Caused by: org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol > > org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client > > = 63, server = 61) > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:403) > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384) > > at > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111) > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213) > > > > > > > > I installed Cloudera Hadoop version 0.20.2+737in on cluster > > mode<https://docs.cloudera.com/display/DOC/CDH3+Deployment+on+a+Cluster>, > so > > Pig is compatible. > > > > > > thanks > > > > Byambaa > > > > >
