Hi,

A while back I emailed about some issues with ILLUSTRATE and a custom LoadFunc impl. I've since fixed those and am now getting a new error. Does this look familiar to anyone?

2009-11-16 10:03:25,570 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/samr/pig/pig_1258394605570.log 2009-11-16 10:03:25,595 [main] INFO org.apache.pig.tools.parameters.PreprocessorContext - Executing command : date +'%Y-%m-%dT%H.%M.%S' 2009-11-16 10:03:25,627 [main] INFO org.apache.pig.tools.parameters.PreprocessorContext - Executing command : whoami 2009-11-16 10:03:25,838 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: ... 2009-11-16 10:03:26,158 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: ... 2009-11-16 10:03:32,375 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: ... 2009-11-16 10:03:32,392 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: jobtracker.ninginc.com:9001 2009-11-16 10:03:32,846 [main] INFO ning.dsp.pig.ThriftStorage - binding to: file1 0 9223372036854775807 2009-11-16 10:03:32,934 [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2009-11-16 10:03:32,935 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:03:32,936 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:03:32,936 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:03:32,936 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:04:26,488 [main] INFO ning.dsp.pig.ThriftStorage - binding to: file2 0 9223372036854775807 2009-11-16 10:04:28,533 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:04:28,533 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:04:28,533 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:04:28,534 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:05:05,524 [main] INFO ning.dsp.pig.ThriftStorage - binding to: file3 0 9223372036854775807 2009-11-16 10:05:05,704 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:05:05,704 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:05:05,704 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:05:05,705 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor 2009-11-16 10:05:11,624 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. null
Details at logfile: /Users/samr/pig/pig_1258394605570.log



Pig Stack Trace
---------------
ERROR 2999: Unexpected internal error. null

java.lang.NullPointerException
at org .apache .pig .pen .LineageTrimmingVisitor .PruneBaseDataConstrainedCoverage(LineageTrimmingVisitor.java:297) at org .apache .pig .pen .LineageTrimmingVisitor.checkCompleteness(LineageTrimmingVisitor.java: 467) at org .apache .pig .pen .LineageTrimmingVisitor.processOperator(LineageTrimmingVisitor.java:425) at org .apache .pig.pen.LineageTrimmingVisitor.visit(LineageTrimmingVisitor.java:249)
        at org.apache.pig.impl.logicalLayer.LOFilter.visit(LOFilter.java:110)
        at org.apache.pig.impl.logicalLayer.LOFilter.visit(LOFilter.java:41)
at org .apache .pig .pen .util .PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:69) at org .apache .pig .pen .util .PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:71) at org .apache .pig .pen .util .PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:71) at org .apache .pig .pen.util.PreOrderDepthFirstWalker.walk(PreOrderDepthFirstWalker.java: 55)
        at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java: 108)
        at org.apache.pig.PigServer.getExamples(PigServer.java:723)
at org .apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java: 545) at org .apache .pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java: 246) at org .apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 168) at org .apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 144)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
        at org.apache.pig.Main.main(Main.java:320)


Sam Rash
[email protected]

Reply via email to