Hi,
A while back I emailed about some issues with ILLUSTRATE and a custom
LoadFunc impl. I've since fixed those and am now getting a new
error. Does this look familiar to anyone?
2009-11-16 10:03:25,570 [main] INFO org.apache.pig.Main - Logging
error messages to: /Users/samr/pig/pig_1258394605570.log
2009-11-16 10:03:25,595 [main] INFO
org.apache.pig.tools.parameters.PreprocessorContext - Executing
command : date +'%Y-%m-%dT%H.%M.%S'
2009-11-16 10:03:25,627 [main] INFO
org.apache.pig.tools.parameters.PreprocessorContext - Executing
command : whoami
2009-11-16 10:03:25,838 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: ...
2009-11-16 10:03:26,158 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to map-reduce job tracker at: ...
2009-11-16 10:03:32,375 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: ...
2009-11-16 10:03:32,392 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to map-reduce job tracker at: jobtracker.ninginc.com:9001
2009-11-16 10:03:32,846 [main] INFO ning.dsp.pig.ThriftStorage -
binding to: file1 0 9223372036854775807
2009-11-16 10:03:32,934 [main] WARN
org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2009-11-16 10:03:32,935 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:03:32,936 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:03:32,936 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:03:32,936 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:04:26,488 [main] INFO ning.dsp.pig.ThriftStorage -
binding to: file2 0 9223372036854775807
2009-11-16 10:04:28,533 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:04:28,533 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:04:28,533 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:04:28,534 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:05:05,524 [main] INFO ning.dsp.pig.ThriftStorage -
binding to: file3 0 9223372036854775807
2009-11-16 10:05:05,704 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:05:05,704 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:05:05,704 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:05:05,705 [main] INFO
org.apache.hadoop.io.compress.CodecPool - Got brand-new decompressor
2009-11-16 10:05:11,624 [main] ERROR org.apache.pig.tools.grunt.Grunt
- ERROR 2999: Unexpected internal error. null
Details at logfile: /Users/samr/pig/pig_1258394605570.log
Pig Stack Trace
---------------
ERROR 2999: Unexpected internal error. null
java.lang.NullPointerException
at
org
.apache
.pig
.pen
.LineageTrimmingVisitor
.PruneBaseDataConstrainedCoverage(LineageTrimmingVisitor.java:297)
at
org
.apache
.pig
.pen
.LineageTrimmingVisitor.checkCompleteness(LineageTrimmingVisitor.java:
467)
at
org
.apache
.pig
.pen
.LineageTrimmingVisitor.processOperator(LineageTrimmingVisitor.java:425)
at
org
.apache
.pig.pen.LineageTrimmingVisitor.visit(LineageTrimmingVisitor.java:249)
at org.apache.pig.impl.logicalLayer.LOFilter.visit(LOFilter.java:110)
at org.apache.pig.impl.logicalLayer.LOFilter.visit(LOFilter.java:41)
at
org
.apache
.pig
.pen
.util
.PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:69)
at
org
.apache
.pig
.pen
.util
.PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:71)
at
org
.apache
.pig
.pen
.util
.PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:71)
at
org
.apache
.pig
.pen.util.PreOrderDepthFirstWalker.walk(PreOrderDepthFirstWalker.java:
55)
at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
at
org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:
108)
at org.apache.pig.PigServer.getExamples(PigServer.java:723)
at
org
.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:
545)
at
org
.apache
.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:
246)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
168)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
144)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:320)
Sam Rash
[email protected]