[ https://issues.apache.org/jira/browse/PIG-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich resolved PIG-755. -------------------------------- Resolution: Fixed With Pig 0.7.0, local mode and MR code use the same code path. > Difficult to debug parameter substitution problems based on the error > messages when running in local mode > --------------------------------------------------------------------------------------------------------- > > Key: PIG-755 > URL: https://issues.apache.org/jira/browse/PIG-755 > Project: Pig > Issue Type: Bug > Components: grunt > Affects Versions: 0.3.0 > Reporter: Viraj Bhat > Attachments: inputfile.txt, localparamsub.pig > > > I have a script in which I do a parameter substitution for the input file. I > have a use case where I find it difficult to debug based on the error > messages in local mode. > {code} > A = load '$infile' using PigStorage() as > ( > date : chararray, > count : long, > gmean : double > ); > dump A; > {code} > 1) I run it in local mode with the input file in the current working directory > {code} > prompt $ java -cp pig.jar:/path/to/hadoop/conf/ org.apache.pig.Main > -exectype local -param infile='inputfile.txt' localparamsub.pig > {code} > 2009-04-07 00:03:51,967 [main] ERROR > org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore > - Received error from storer function: > org.apache.pig.backend.executionengine.ExecException: ERROR 2081: Unable to > setup the load function. > 2009-04-07 00:03:51,970 [main] INFO > org.apache.pig.backend.local.executionengine.LocalPigLauncher - Failed jobs!! > 2009-04-07 00:03:51,971 [main] INFO > org.apache.pig.backend.local.executionengine.LocalPigLauncher - 1 out of 1 > failed! > 2009-04-07 00:03:51,974 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1066: Unable to open iterator for alias A > ==================================================================== > Details at logfile: /home/viraj/pig-svn/trunk/pig_1239062631414.log > ==================================================================== > ERROR 1066: Unable to open iterator for alias A > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias A > at org.apache.pig.PigServer.openIterator(PigServer.java:439) > at > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:359) > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:193) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:99) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:88) > at org.apache.pig.Main.main(Main.java:352) > Caused by: java.io.IOException: Job terminated with anomalous status FAILED > at org.apache.pig.PigServer.openIterator(PigServer.java:433) > ... 5 more > ==================================================================== > 2) I run it in map reduce mode > {code} > prompt $ java -cp pig.jar:/path/to/hadoop/conf/ org.apache.pig.Main -param > infile='inputfile.txt' localparamsub.pig > {code} > 2009-04-07 00:07:31,660 [main] INFO > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting > to hadoop file system at: hdfs://localhost:9000 > 2009-04-07 00:07:32,074 [main] INFO > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting > to map-reduce job tracker at: localhost:9001 > 2009-04-07 00:07:34,543 [Thread-7] WARN org.apache.hadoop.mapred.JobClient - > Use GenericOptionsParser for parsing the arguments. Applications should > implement Tool for the same. > 2009-04-07 00:07:39,540 [main] INFO > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 0% complete > 2009-04-07 00:07:39,540 [main] ERROR > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - Map reduce job failed > 2009-04-07 00:07:39,563 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 2100: inputfile does not exist. > ==================================================================== > Details at logfile: /home/viraj/pig-svn/trunk/pig_1239062851400.log > ==================================================================== > ERROR 2100: inputfile does not exist. > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias A > at org.apache.pig.PigServer.openIterator(PigServer.java:439) > at > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:359) > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:193) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:99) > at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:88) > at org.apache.pig.Main.main(Main.java:352) > Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: > Unable to store alias A > at org.apache.pig.PigServer.store(PigServer.java:470) > at org.apache.pig.PigServer.openIterator(PigServer.java:427) > ... 5 more > Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: > Unable to store alias A > at org.apache.pig.PigServer.store(PigServer.java:503) > at org.apache.pig.PigServer.store(PigServer.java:466) > ... 6 more > Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2997: > Unable to recreate exception from backend error: > org.apache.pig.backend.executionengine.ExecException: ERROR 2100: inputfile > does not exist. > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:135) > ==================================================================== > Here is evident that the error occurred because "input.txt" was truncated to > "input" -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.