[ 
https://issues.apache.org/jira/browse/CALCITE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939819#comment-17939819
 ] 

Mihai Budiu commented on CALCITE-6930:
--------------------------------------

I can see some additional advantages:
- the predicates may be pulled up after separation
- the predicates may become conjunctions, which may provide more efficient 
implementations

> Implementing JoinConditionOrExpansionRule
> -----------------------------------------
>
>                 Key: CALCITE-6930
>                 URL: https://issues.apache.org/jira/browse/CALCITE-6930
>             Project: Calcite
>          Issue Type: New Feature
>            Reporter: Zhen Chen
>            Assignee: Zhen Chen
>            Priority: Major
>              Labels: pull-request-available
>
> JoinConditionOrExpansionRule transforms a join with OR conditions into a 
> UNION ALL of multiple joins.
> For example, the SQL:
> {code:java}
> SELECT * FROM emp JOIN dept 
> ON emp.deptno = dept.deptno OR emp.deptno = dept.mgr {code}
> Will be transformed into:
> {code:java}
> SELECT * FROM emp JOIN dept ON emp.deptno = dept.deptno
> UNION ALL 
> SELECT * FROM emp JOIN dept ON emp.deptno = dept.mgr {code}
> The original plan:
> {code:java}
> LogicalJoin(condition=[OR(=(deptno, deptno), =(deptno, mgr))])
>   LogicalTableScan(table=emp)
>     LogicalTableScan(table=dept) {code}
> Is transformed to:
> {code:java}
> LogicalUnion(all=[true])
>   LogicalJoin(condition=[=(deptno, deptno)])
>    LogicalTableScan(table=emp)
>    LogicalTableScan(table=dept)
>   LogicalJoin(condition=[=(deptno, mgr)])
>   LogicalTableScan(table=emp)
>   LogicalTableScan(table=dept) {code}
> Benefits:
>  # Each individual join can use hash-join algorithm, which is more efficient 
> than nested-loop joins required for OR conditions.
>  # Each join branch can independently choose its optimal join implementation.
>  # The joins can be executed in parallel.
>  # Individual joins may be able to use indexes that would not be usable with 
> OR conditions.
> The rule only fires when:
>  # The OR condition contains only simple equi-join conditions (comparing 
> columns between left and right inputs).
> Limitations and considerations:
>  # May not improve performance if individual joins produce large results that 
> need to be union-ed.
>  # Multiple hash tables may cause memory pressure.
>  # The optimizer should consider statistics and cost estimates when applying 
> this rule.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to