[
https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157650#comment-16157650
]
Koji Noguchi commented on PIG-5299:
-----------------------------------
Log file showing the trace.
{noformat}
Pig Stack Trace
---------------
ERROR 2243: Attempt to remove operator GreaterThanEqual that is still connected
in the plan
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open
iterator for alias B
at org.apache.pig.PigServer.openIterator(PigServer.java:1020)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:782)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:383)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:630)
at org.apache.pig.Main.main(Main.java:175)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias B
at org.apache.pig.PigServer.storeEx(PigServer.java:1123)
at org.apache.pig.PigServer.store(PigServer.java:1082)
at org.apache.pig.PigServer.openIterator(PigServer.java:995)
... 7 more
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2000:
Error processing rule PartitionFilterOptimizer. Try -t PartitionFilterOptimizer
at
org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:125)
at
org.apache.pig.newplan.logical.relational.LogicalPlan.optimize(LogicalPlan.java:281)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1458)
at org.apache.pig.PigServer.storeEx(PigServer.java:1119)
... 9 more
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2243:
Attempt to remove operator GreaterThanEqual that is still connected in the plan
at
org.apache.pig.newplan.BaseOperatorPlan.remove(BaseOperatorPlan.java:172)
at
org.apache.pig.newplan.FilterExtractor.removeFromFilteredPlan(FilterExtractor.java:340)
at
org.apache.pig.newplan.FilterExtractor.removeFromFilteredPlan(FilterExtractor.java:337)
at
org.apache.pig.newplan.FilterExtractor.removeFromFilteredPlan(FilterExtractor.java:337)
at
org.apache.pig.newplan.FilterExtractor.checkPushDown(FilterExtractor.java:255)
at
org.apache.pig.newplan.FilterExtractor.visit(FilterExtractor.java:106)
at
org.apache.pig.newplan.logical.rules.PartitionFilterOptimizer$PartitionFilterPushDownTransformer.transform(PartitionFilterOptimizer.java:155)
at
org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:110)
... 12 more
{noformat}
Basically when PartitionFilterOptimizer gives up on pushing down certain filter
condition, updating the filteredPlan is failing.
> PartitionFilterOptimizer failing at compile time
> ------------------------------------------------
>
> Key: PIG-5299
> URL: https://issues.apache.org/jira/browse/PIG-5299
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
>
> Following (rather simple) code
> {code:title=test.pig}
> A = LOAD '/tmp/testinput' using org.apache.pig.test.TestLoader ('srcid:int,
> mrkt:chararray, dstid:int, name:chararray', 'srcid'); --srcid is the
> partition-key
> B= filter A by dstid != 10 OR ((dstid < 3000 and srcid == 1000) OR (dstid >=
> 3000 and srcid == 2000));
> dump B;
> {code}
> is failing with
> {panel}
> 2017-09-07 16:37:03,210 \[main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 2243: Attempt to remove operator GreaterThanEqual that is still
> connected in the plan
> {panel}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
