What is the output of "pig -secretDebugCmd" On Thu, Mar 21, 2013 at 1:29 PM, Ryan Compton <[email protected]>wrote:
> Hi, > > Hmm, I've got that much: > > -bash-3.2$ ls $HADOOP_HOME | grep cdh3u3 > hadoop-0.20.2-cdh3u3-ant.jar > hadoop-0.20.2-cdh3u3-core.jar > hadoop-0.20.2-cdh3u3-examples.jar > hadoop-0.20.2-cdh3u3-test.jar > hadoop-0.20.2-cdh3u3-tools.jar > hadoop-ant-0.20.2-cdh3u3.jar > hadoop-core-0.20.2-cdh3u3.jar > hadoop-examples-0.20.2-cdh3u3.jar > hadoop-test-0.20.2-cdh3u3.jar > hadoop-tools-0.20.2-cdh3u3.jar > > but I still have the same problem. More info: http://pastebin.com/MfUHwu0X > > On Thu, Mar 21, 2013 at 1:16 PM, Prashant Kommireddi > <[email protected]> wrote: > > Hi Ryan, > > > > Seems like you are trying to connect to a hadoop cluster running 0.20.2. > > Pig by default uses hadoop 1.0 unless you specify otherwise. > > > > You should point HADOOP_HOME to your hadoop installation dir > > (0.20.2-cdh3u3) from where you are launching pig > > > > export HADOOP_HOME=<path_to_0.20.2-cdh3u3> > > > > > > On Thu, Mar 21, 2013 at 12:59 PM, Ryan Compton <[email protected] > >wrote: > > > >> I can start a grunt shell just fine: > >> > >> -bash-3.2$ pwd > >> /home/rfcompton/Downloads/pig-0.11.0-src > >> -bash-3.2$ ./bin/pig > >> 2013-03-21 12:55:00,048 [main] INFO org.apache.pig.Main - Apache Pig > >> version 0.11.1-SNAPSHOT (rexported) compiled Mar 21 2013, 12:49:21 > >> 2013-03-21 12:55:00,049 [main] INFO org.apache.pig.Main - Logging > >> error messages to: > >> /home/rfcompton/Downloads/pig-0.11.0-src/pig_1363895700046.log > >> 2013-03-21 12:55:00,076 [main] INFO org.apache.pig.impl.util.Utils - > >> Default bootup file /home/rfcompton/.pigbootup not found > >> 2013-03-21 12:55:00,330 [main] INFO > >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - > >> Connecting to hadoop file system at: hdfs://master:8020/ > >> 2013-03-21 12:55:00,581 [main] INFO > >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - > >> Connecting to map-reduce job tracker at: node4:8021 > >> grunt> > >> > >> But I can't run a java program: > >> > >> -bash-3.2$ java -cp > >> > >> > target/mybigjar-1.1-SNAPSHOT-jar-with-dependencies.jar:$HADOOP_CONF_DIR:/home/rfcompton/Downloads/pig-0.11.0-src/pig.jar > >> org.apache.pig.Main > >> 2013-03-21 12:55:58,806 [main] INFO org.apache.pig.Main - Apache Pig > >> version 0.11.1-SNAPSHOT (rexported) compiled Mar 21 2013, 12:49:21 > >> 2013-03-21 12:55:58,806 [main] INFO org.apache.pig.Main - Logging > >> error messages to: /home/rfcompton/pig_1363895758801.log > >> 2013-03-21 12:55:58,829 [main] INFO org.apache.pig.impl.util.Utils - > >> Default bootup file /home/rfcompton/.pigbootup not found > >> 2013-03-21 12:55:59,086 [main] INFO > >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - > >> Connecting to hadoop file system at: hdfs://master:8020/ > >> 2013-03-21 12:56:03,844 [main] ERROR org.apache.pig.Main - ERROR 2999: > >> Unexpected internal error. Failed to create DataStorage > >> Details at logfile: > >> /home/rfcompton/myshrep/OSI/Code/geocoderV2/pig_1363895758801.log > >> -bash-3.2$ > >> > >> So I did this: > >> > https://cwiki.apache.org/confluence/display/PIG/FAQ#FAQ-Q%3AWhatshallIdoifIsaw%22FailedtocreateDataStorage%22%3F > >> and it didn't help. > >> > >> If it matters, > >> > >> -bash-3.2$ hadoop version > >> Hadoop 0.20.2-cdh3u3 > >> >
