You can also test quickly if thats the issue by running the following command:
hadoop fs -text /data/arpumsisdn.txt | tail On Wed, Oct 5, 2011 at 8:24 AM, Alex Rovner <[email protected]> wrote: > Kiran, > > This looks like your HDFS is missing some blocks. Can you run fsck and see > if you have missing blocks and if so for what files? > > http://hadoop.apache.org/common/docs/r0.17.2/hdfs_user_guide.html#Fsck > > Alex > > > On Tue, Oct 4, 2011 at 7:53 AM, kiranprasad > <[email protected]>wrote: > >> I am getting the below exception when trying to execute PIG latin script. >> >> Failed! >> >> Failed Jobs: >> JobId Alias Feature Message Outputs >> job_201110042009_0005 A MAP_ONLY Message: Job failed! >> hdfs://10.0.0.61/tmp/temp1751671187/tmp-592386019, >> >> Input(s): >> Failed to read data from "/data/arpumsisdn.txt" >> >> Output(s): >> Failed to produce result in "hdfs:// >> 10.0.0.61/tmp/temp1751671187/tmp-592386019" >> >> Counters: >> Total records written : 0 >> Total bytes written : 0 >> Spillable Memory Manager spill count : 0 >> Total bags proactively spilled: 0 >> Total records proactively spilled: 0 >> >> Job DAG: >> job_201110042009_0005 >> >> >> 2011-10-04 22:13:53,736 [main] INFO >> >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - Failed! >> 2011-10-04 22:13:53,745 [main] ERROR org.apache.pig.tools.grunt.Grunt - >> ERROR 1066: Unable to open iterator for alias A. Backend error : Could not >> obtain block: blk_-8354424441116992221_1060 file=/data/arpumsisdn.txt >> Details at logfile: /home/kiranprasad.g/pig-0.8.1/pig_1317746514798.log >> >> >> >> Regards >> Kiran.G > > >
