Hi,
I stripped out everything from my perl script and just printing a hello world.
#!/usr/bin/perl
print "hello world\n";
within my pig script I am running the script as
DEFINE CMD `./test.pl`
SHIP ('/home/test/test.pl')
STREAM LOGS THROUGH `./test.pl` AS testword;
Now I get the following error (doesn't show any exit status code)
2011-09-25 10:11:45,822 WARN org.apache.hadoop.mapred.Child: Error running child
org.apache.pig.backend.executionengine.ExecException: ERROR 2055: Received
Error while processing the map plan.
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:265)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
any info is appreciated.
Thanks,
Deepak Reddy
-----Original Message-----
From: Xiaomeng Wan [mailto:[email protected]]
Sent: Saturday, September 24, 2011 12:27 PM
To: [email protected]
Subject: Re: Streaming error
also make sure it is executable before pack/ship it
Shawn
On Sat, Sep 24, 2011 at 5:57 AM, Norbert Burger <[email protected]>
wrote:
> BASH exit status of 127 is a "command not found":
>
> http://tldp.org/LDP/abs/html/exitcodes.html
>
> Does geostream.pl shell out to other commands, or otherwise rely on $PATH?
> Using fully-qualified paths may help.
>
> Norbert
>
> On Fri, Sep 23, 2011 at 6:59 PM, Deepak Reddy <[email protected]> wrote:
>
>> This is from the job track error log
>>
>> org.apache.pig.backend.executionengine.ExecException: ERROR 2055:
>> Received Error while processing the map plan: 'geostream.pl GeoLiteCity.dat '
>> failed with exit status: 127
>> at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBa
>> se.runPipeline(PigMapBase.java:265)
>> at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBa
>> se.map(PigMapBase.java:232)
>> at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBa
>> se.map(PigMapBase.java:53)
>> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
>> tion.java:1127)
>> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>>
>> Thanks,
>> Deepak Reddy
>>
>> -----Original Message-----
>> From: Daniel Dai [mailto:[email protected]]
>> Sent: Friday, September 23, 2011 3:56 PM
>> To: [email protected]
>> Subject: Re: Streaming error
>>
>> Go to JobtrackerUI to get more detailed error message.
>>
>> On Fri, Sep 23, 2011 at 3:54 PM, Deepak Reddy <[email protected]>
>> wrote:
>>
>> > Hi,
>> >
>> > I am trying to run a pig streaming perl job using GeoLite DB and I
>> > am getting the following failure
>> >
>> > 2011-09-23 15:49:44,902 [main] ERROR
>> > org.apache.pig.tools.pigstats.PigStats
>> > - ERROR 2997: Unable to recreate exception from backed error:
>> > org.apache.pig.backend.executionengine.ExecException: ERROR 2055:
>> > Received Error while processing the map plan: '/usr/bin/perl
>> > geostream.plGeoLiteCity.dat ' failed with exit status: 2
>> >
>> > I am shipping all the perl scripts(modules) and using the cached
>> > geolite DB on HDFS
>> >
>> > Can you please give me some pointers.
>> >
>> > Thank you,
>> > Deepak Reddy
>> >
>>
>
