[
https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157678#comment-16157678
]
Koji Noguchi commented on PIG-5299:
-----------------------------------
Pasting filter plan with hashcode (to check the uniqueness)
{noformat}
|---(Name: Constant Type: null Uid: null):1947185929
(Name: And Type: null Uid: null):1774720883
|
|---(Name: Or Type: null Uid: null):1605851606
| |
| |---(Name: Equal Type: null Uid: null):1534754611
| | |
| | |---(Name: Project Type: null Uid: null Input: 0 Column: 0):944140566
| | |
| | |---(Name: Constant Type: null Uid: null):1551446957
| |
| |---(Name: GreaterThanEqual Type: null Uid: null):1020154737
| |
| |---(Name: Project Type: null Uid: null Input: 0 Column: 2):987249254
| |
| |---(Name: Constant Type: null Uid: null):1850954068
|
|---(Name: And Type: null Uid: null):1440621772
|
|---(Name: Or Type: null Uid: null):352083716
| |
| |---(Name: LessThan Type: null Uid: null):713312506
| | |
| | |---(Name: Project Type: null Uid: null Input: 0 Column:
2):597307515
| | |
| | |---(Name: Constant Type: null Uid: null):770010802
| |
| |---(Name: Equal Type: null Uid: null):223693919
| |
| |---(Name: Project Type: null Uid: null Input: 0 Column:
0):1758056825
| |
| |---(Name: Constant Type: null Uid: null):361268035
|
|---(Name: Or Type: null Uid: null):1787189503
|
|---(Name: LessThan Type: null Uid: null):713312506
| |
| |---(Name: Project Type: null Uid: null Input: 0 Column:
2):597307515
| |
| |---(Name: Constant Type: null Uid: null):770010802
|
|---(Name: GreaterThanEqual Type: null Uid: null):1020154737
|
|---(Name: Project Type: null Uid: null Input: 0 Column:
2):987249254
|
|---(Name: Constant Type: null Uid: null):1850954068
{noformat}
This {{|---(Name: GreaterThanEqual Type: null Uid: null):1020154737}} is used
twice in the plan.
One from
{{|---(Name: Or Type: null Uid: null):1605851606}}
and another from
{{|---(Name: Or Type: null Uid: null):1787189503}}
Error message
bq. Attempt to remove operator GreaterThanEqual that is still connected in the
plan
is coming when FilterExtractor tries to remove GreaterThanEqual from the first
OR:1605851606 but failing when GreaterThanEqual is still connected to
OR:1787189503.
> PartitionFilterOptimizer failing at compile time
> ------------------------------------------------
>
> Key: PIG-5299
> URL: https://issues.apache.org/jira/browse/PIG-5299
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
>
> Following (rather simple) code
> {code:title=test.pig}
> A = LOAD '/tmp/testinput' using org.apache.pig.test.TestLoader ('srcid:int,
> mrkt:chararray, dstid:int, name:chararray', 'srcid'); --srcid is the
> partition-key
> B= filter A by dstid != 10 OR ((dstid < 3000 and srcid == 1000) OR (dstid >=
> 3000 and srcid == 2000));
> dump B;
> {code}
> is failing with
> {panel}
> 2017-09-07 16:37:03,210 \[main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 2243: Attempt to remove operator GreaterThanEqual that is still
> connected in the plan
> {panel}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
