[ https://issues.apache.org/jira/browse/PIG-903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-903: ------------------------------- Fix Version/s: 0.9.0 > ILLUSTRATE fails on 'Distinct' operator > --------------------------------------- > > Key: PIG-903 > URL: https://issues.apache.org/jira/browse/PIG-903 > Project: Pig > Issue Type: Bug > Reporter: Dmitriy V. Ryaboy > Fix For: 0.9.0 > > > Using the latest Pig from trunk (0.3+) in mapreduce mode, running through the > tutorial script script1-hadoop.pig works fine. > However, executing the following illustrate command throws an exception: > illustrate ngramed2 > Pig Stack Trace > --------------- > ERROR 2999: Unexpected internal error. Unrecognized logical operator. > java.lang.RuntimeException: Unrecognized logical operator. > at > org.apache.pig.pen.EquivalenceClasses.GetEquivalenceClasses(EquivalenceClasses.java:60) > at > org.apache.pig.pen.DerivedDataVisitor.evaluateOperator(DerivedDataVisitor.java:368) > at > org.apache.pig.pen.DerivedDataVisitor.visit(DerivedDataVisitor.java:226) > at > org.apache.pig.impl.logicalLayer.LODistinct.visit(LODistinct.java:104) > at > org.apache.pig.impl.logicalLayer.LODistinct.visit(LODistinct.java:37) > at > org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68) > at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51) > at > org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:98) > at > org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:90) > at > org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:106) > at org.apache.pig.PigServer.getExamples(PigServer.java:724) > at > org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:541) > at > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:195) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165) > at > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141) > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:75) > at org.apache.pig.Main.main(Main.java:361) > ================================================================================ > This works: > illustrate ngramed1; > Although it does throw a few NPEs : > java.lang.NullPointerException > at > org.apache.pig.pen.util.DisplayExamples.ShortenField(DisplayExamples.java:205) > at > org.apache.pig.pen.util.DisplayExamples.MakeArray(DisplayExamples.java:190) > at > org.apache.pig.pen.util.DisplayExamples.PrintTabular(DisplayExamples.java:86) > [...] > (illustrate also doesn't work on bzipped input, but that's a separate issue) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.