Correct, 0.7 works with Hadoop 20.x -----Original Message----- From: Saurav Datta [mailto:sda...@apple.com] Sent: Friday, August 27, 2010 2:58 PM To: pig-user@hadoop.apache.org Subject: Re: Failed to create DataStorage
Thanks Alan ! Will Pig 0.7.0 run on Hadoop 0.20.x ? Or should we use any other Hadoop release ? Regards, Saurav On Aug 27, 2010, at 2:50 PM, Alan Gates wrote: > Pig has not been tested with Hadoop 0.21, so I don't know if this > will work or not. > > Alan. > > On Aug 27, 2010, at 2:42 PM, Saurav Datta wrote: > >> Hi , >> >> I am trying to run Pig 0.7.0 on Hadoop 0.21.0 . >> >> Getting the below error : >> >> $ pig >> 10/08/27 14:38:18 INFO pig.Main: Logging error messages to: /Users/ >> rahulmalviya/Documents/Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log >> 2010-08-27 14:38:19,245 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - >> Connecting to hadoop file system at: hdfs://localhost:9000 >> 2010-08-27 14:38:19,600 [main] ERROR org.apache.pig.Main - ERROR >> 2999: >> Unexpected internal error. Failed to create DataStorage >> Details at logfile: /Users/rahulmalviya/Documents/Hadoop/ >> hadoop-0.21.0/ >> bin/pig_1282945098943.log >> >> Is this a version issue ? Any suggestions ? >> >> Let me know if you need any information from me to debug this . >> >> Thanks in advance , >> Saurav >> >> >> >> P.S: Below is the content of the log file. >> >> isdevmars002:bin rahulmalviya$ cat /Users/rahulmalviya/Documents/ >> Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log >> Error before Pig is launched >> ---------------------------- >> ERROR 2999: Unexpected internal error. Failed to create DataStorage >> >> java.lang.RuntimeException: Failed to create DataStorage >> at >> org >> .apache >> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java: >> 75) >> at >> org >> .apache >> .pig >> .backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java: >> 58) >> at >> org >> .apache >> .pig >> .backend >> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java: >> 216) >> at >> org >> .apache >> .pig >> .backend >> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java: >> 126) >> at org.apache.pig.impl.PigContext.connect(PigContext.java:184) >> at org.apache.pig.PigServer.<init>(PigServer.java:184) >> at org.apache.pig.PigServer.<init>(PigServer.java:173) >> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:54) >> at org.apache.pig.Main.main(Main.java:354) >> Caused by: java.io.IOException: Call to localhost/127.0.0.1:9000 >> failed on local exception: java.io.EOFException >> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775) >> at org.apache.hadoop.ipc.Client.call(Client.java:743) >> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) >> at $Proxy0.getProtocolVersion(Unknown Source) >> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) >> at >> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java: >> 106) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170) >> at >> org >> .apache >> .hadoop >> .hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) >> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java: >> 1378) >> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) >> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) >> at >> org >> .apache >> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java: >> 72) >> ... 8 more >> Caused by: java.io.EOFException >> at java.io.DataInputStream.readInt(DataInputStream.java:375) >> at org.apache.hadoop.ipc.Client >> $Connection.receiveResponse(Client.java:501) >> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446) >> = >> = >> = >> = >> = >> = >> = >> = >> = >> = >> = >> ===================================================================== >> >
