Hi,
I implemented a custom loadfunc class to read data from a database. This class
implements both Slicer and LoadFunc. It also generates the slices properly. The
problem is that when I perform this query:
A = LOAD 'table_name' USING CustomStorage;
DUMP A;
The PIG gives the following error message:
2009-10-25 23:27:34,308 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
2009-10-25 23:27:39,920 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
6017: Execution failed, while processing
hdfs://access0:9000/tmp/temp1662058595/tmp-659297059
2009-10-25 23:27:39,920 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open
iterator for alias A
at org.apache.pig.PigServer.openIterator(PigServer.java:475)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:532)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:190)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:166)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:142)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:320)
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002:
Unable to store alias A
at org.apache.pig.PigServer.store(PigServer.java:530)
at org.apache.pig.PigServer.openIterator(PigServer.java:458)
... 6 more
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 6017:
Execution failed, while processing
hdfs://access0:9000/tmp/temp1662058595/tmp-659297059
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:773)
at org.apache.pig.PigServer.store(PigServer.java:522)
... 7 more
I am sure that getLocations returns the correct paths. And when I try to add in
more log displays in my custom Slice, it does not show up as it runs in
Map/Reduce.
How am I supposed to debug this? Is there any way to retrieve more detailed
exception from the plan execution?
Thanks,
Richard
_________________________________________________________________
全新 Windows 7：简化您的日常工作。寻找最适合您的 PC。
http://www.microsoft.com/china/windows/buy/
