These are the STDERR logs stderr logs
===== Task Information Header ===== Command: ./test.pl (stdin-org.apache.pig.builtin.PigStreaming/stdout-org.apache.pig.builtin.PigStreaming) Start time: Sun Sep 25 11:34:09 PDT 2011 Input-split file: null Input-split start-offset: -1 Input-split length: -1 ===== * * * ===== log4j:WARN No appenders could be found for logger (org.apache.hadoop.hdfs.DFSClient). log4j:WARN Please initialize the log4j system properly. -DR -----Original Message----- From: Deepak Reddy [mailto:[email protected]] Sent: Sunday, September 25, 2011 11:39 AM To: [email protected] Subject: RE: Streaming error Same error as before when I try with STREAM LOGS THROUGH CMD AS testword; 2011-09-25 11:36:50,182 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2997: Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 2055: Received Error while processing the map plan. 2011-09-25 11:36:50,182 [main] ERROR org.apache.pig.tools.grunt.GruntParser - org.apache.pig.backend.executionengine.ExecException: ERROR 2997: Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 2055: Received Error while processing the map plan. at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:221) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:151) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:337) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:382) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1209) at org.apache.pig.PigServer.execute(PigServer.java:1201) at org.apache.pig.PigServer.access$100(PigServer.java:129) at org.apache.pig.PigServer$Graph.execute(PigServer.java:1528) at org.apache.pig.PigServer.executeBatchEx(PigServer.java:373) at org.apache.pig.PigServer.executeBatch(PigServer.java:340) at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144) at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90) at org.apache.pig.Main.run(Main.java:396) at org.apache.pig.Main.main(Main.java:107) thanks, DR -----Original Message----- From: Jonathan Coveney [mailto:[email protected]] Sent: Sunday, September 25, 2011 11:28 AM To: [email protected] Subject: Re: Streaming error I believe that STREAM LOGS THROUGH `./test.pl` AS testword; should be STREAM LOGS THROUGH CMD AS testword; 2011/9/25 Deepak Reddy <[email protected]> > Hi, > > I stripped out everything from my perl script and just printing a > hello world. > > #!/usr/bin/perl > print "hello world\n"; > > within my pig script I am running the script as > > DEFINE CMD `./test.pl` > SHIP ('/home/test/test.pl') > > STREAM LOGS THROUGH `./test.pl` AS testword; > > Now I get the following error (doesn't show any exit status code) > > 2011-09-25 10:11:45,822 WARN org.apache.hadoop.mapred.Child: Error > running child > org.apache.pig.backend.executionengine.ExecException: ERROR 2055: > Received Error while processing the map plan. > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:265) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323) > at org.apache.hadoop.mapred.Child$4.run(Child.java:270) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) > at org.apache.hadoop.mapred.Child.main(Child.java:264) > > any info is appreciated. > Thanks, > Deepak Reddy > > -----Original Message----- > From: Xiaomeng Wan [mailto:[email protected]] > Sent: Saturday, September 24, 2011 12:27 PM > To: [email protected] > Subject: Re: Streaming error > > also make sure it is executable before pack/ship it > > Shawn > > On Sat, Sep 24, 2011 at 5:57 AM, Norbert Burger > <[email protected]> > wrote: > > BASH exit status of 127 is a "command not found": > > > > http://tldp.org/LDP/abs/html/exitcodes.html > > > > Does geostream.pl shell out to other commands, or otherwise rely on > $PATH? > > Using fully-qualified paths may help. > > > > Norbert > > > > On Fri, Sep 23, 2011 at 6:59 PM, Deepak Reddy > > <[email protected]> > wrote: > > > >> This is from the job track error log > >> > >> org.apache.pig.backend.executionengine.ExecException: ERROR 2055: > >> Received Error while processing the map plan: 'geostream.plGeoLiteCity.dat > >> ' > >> failed with exit status: 127 > >> at > >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMap > >> Ba > >> se.runPipeline(PigMapBase.java:265) > >> at > >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMap > >> Ba > >> se.map(PigMapBase.java:232) > >> at > >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMap > >> Ba > >> se.map(PigMapBase.java:53) > >> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > >> at > >> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647) > >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323) > >> at org.apache.hadoop.mapred.Child$4.run(Child.java:270) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at javax.security.auth.Subject.doAs(Subject.java:396) > >> at > >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInfor > >> ma > >> tion.java:1127) > >> at org.apache.hadoop.mapred.Child.main(Child.java:264) > >> > >> Thanks, > >> Deepak Reddy > >> > >> -----Original Message----- > >> From: Daniel Dai [mailto:[email protected]] > >> Sent: Friday, September 23, 2011 3:56 PM > >> To: [email protected] > >> Subject: Re: Streaming error > >> > >> Go to JobtrackerUI to get more detailed error message. > >> > >> On Fri, Sep 23, 2011 at 3:54 PM, Deepak Reddy > >> <[email protected]> > >> wrote: > >> > >> > Hi, > >> > > >> > I am trying to run a pig streaming perl job using GeoLite DB and > >> > I am getting the following failure > >> > > >> > 2011-09-23 15:49:44,902 [main] ERROR > >> > org.apache.pig.tools.pigstats.PigStats > >> > - ERROR 2997: Unable to recreate exception from backed error: > >> > org.apache.pig.backend.executionengine.ExecException: ERROR 2055: > >> > Received Error while processing the map plan: '/usr/bin/perl > >> > geostream.plGeoLiteCity.dat ' failed with exit status: 2 > >> > > >> > I am shipping all the perl scripts(modules) and using the cached > >> > geolite DB on HDFS > >> > > >> > Can you please give me some pointers. > >> > > >> > Thank you, > >> > Deepak Reddy > >> > > >> > > >
