[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch Available) Fails are not related. Pushed to master, thanks for the review [~ashutoshc]! I will create the follow-up JIRA for the cartesian product merging and link it to this issue. > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 2.1.0 > > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.07.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: (was: HIVE-12543.07.patch) > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.07.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.07.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.07.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.07.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.07.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.06.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: (was: HIVE-12543.06.patch) > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.06.patch New patch solves issues with DynamicPartitionPruning (unnecessarily execution). Triggering new QA. > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.06.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.05.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.05.patch, > HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.04.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.04.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.03.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: (was: HIVE-12543.03.patch) > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.03.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch, > HIVE-12543.03.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[
https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jesus Camacho Rodriguez updated HIVE-12543:
---
Attachment: HIVE-12543.02.patch
New version of the patch, still merged with HIVE-12478.
The patch removes 2 out of 3 calls to ConstantPropagate; the last call needs
further investigation, as there is some interaction with RewriteGBUsingIndex
rule.
ReduceExpressions in Calcite needed to be extended to remove {{isnotnull}}
factors if there is already a null filtering condition in the same conjunction.
Further, recognition of {{case}} in Calcite needed to be implemented so we can
take advantage of the special logic in Reduce expressions for {{case}}.
Finally, recognition of {{!=}} as "not equals" operator in Calcite has also
been included.
> Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
>
>
> Key: HIVE-12543
> URL: https://issues.apache.org/jira/browse/HIVE-12543
> Project: Hive
> Issue Type: Sub-task
> Components: CBO, Logical Optimizer
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-12543.01.patch, HIVE-12543.02.patch,
> HIVE-12543.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.01.patch > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.01.patch, HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-12899 > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Sub-task > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12543) Disable Hive ConstantPropagate optimizer when CBO has optimized the plan
[ https://issues.apache.org/jira/browse/HIVE-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-12543: --- Attachment: HIVE-12543.patch Uploaded a patch that combines the work in HIVE-12478 with disabling ConstantPropagate. This will give us a first idea of what is currently missing on the Calcite site wrt Hive optimizer, and what would be needed in a simplified version of ConstantPropagate optimizer. > Disable Hive ConstantPropagate optimizer when CBO has optimized the plan > > > Key: HIVE-12543 > URL: https://issues.apache.org/jira/browse/HIVE-12543 > Project: Hive > Issue Type: Bug > Components: CBO, Logical Optimizer >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12543.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
