[
https://issues.apache.org/jira/browse/IMPALA-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianqing He updated IMPALA-11536:
---------------------------------
Description:
When set ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION = true;
It may invalid push down the predicate that is not null rejecting in outer
join simplification.
e.g.
SELECT COALESCE(jointbl.test_id, testtbl.id, dimtbl.id) AS id,
test_zip,testtbl.zip
FROM functional.jointbl
FULL OUTER JOIN
functional.testtbl
ON jointbl.test_id = testtbl.id
FULL OUTER JOIN
functional.dimtbl
ON coalesce(jointbl.test_id, testtbl.id) = dimtbl.id
WHERE
`jointbl`.`test_zip` = 94611 and coalesce(`testtbl`.`zip`, 0) = 0;
!image-2022-08-25-14-47-51-966.png!
We can't push down the predicate 'coalesce(testtbl.zip, 0) = 0' to ScanNode
since it is not null rejecting
was:
When set ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION = true;
It may invalid push down the predicate that is not null rejecting in outer
join simplification.
e.g.
SELECT COALESCE(jointbl.test_id, testtbl.id, dimtbl.id) AS id,
test_zip,testtbl.zip
FROM functional.jointbl
FULL OUTER JOIN
functional.testtbl
ON jointbl.test_id = testtbl.id
FULL OUTER JOIN
functional.dimtbl
ON coalesce(jointbl.test_id, testtbl.id) = dimtbl.id
WHERE
`jointbl`.`test_zip` = 94611 and coalesce(`testtbl`.`zip`, 0) = 0;
PLAN-ROOT SINK
|
07:EXCHANGE [UNPARTITIONED]
|
04:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
| hash predicates: coalesce(jointbl.test_id, testtbl.id) = dimtbl.id
| row-size=32B cardinality=6
|
|--06:EXCHANGE [BROADCAST]
| |
| 02:SCAN HDFS [functional.dimtbl]
| HDFS partitions=1/1 files=1 size=171B
| row-size=8B cardinality=10
|
03:HASH JOIN [LEFT OUTER JOIN, BROADCAST]
| hash predicates: jointbl.test_id = testtbl.id
| row-size=24B cardinality=6
|
|--05:EXCHANGE [BROADCAST]
| |
| 01:SCAN HDFS [functional.testtbl]
| HDFS partitions=1/1 files=0 size=0B
| predicates: coalesce(testtbl.zip, 0) = 0
| row-size=12B cardinality=0
|
00:SCAN HDFS [functional.jointbl]
HDFS partitions=1/1 files=1 size=433B
predicates: jointbl.test_zip = 94611
row-size=12B cardinality=6
We can't push down the predicate 'coalesce(testtbl.zip, 0) = 0' to ScanNode
since it is not null rejecting
> Invalid push down predicates in outer join simplification
> ---------------------------------------------------------
>
> Key: IMPALA-11536
> URL: https://issues.apache.org/jira/browse/IMPALA-11536
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.0.0, Impala 4.1.0
> Reporter: Xianqing He
> Assignee: Xianqing He
> Priority: Major
> Fix For: Impala 4.2.0
>
> Attachments: image-2022-08-25-14-47-51-966.png
>
>
> When set ENABLE_OUTER_JOIN_TO_INNER_TRANSFORMATION = true;
> It may invalid push down the predicate that is not null rejecting in outer
> join simplification.
> e.g.
> SELECT COALESCE(jointbl.test_id, testtbl.id, dimtbl.id) AS id,
> test_zip,testtbl.zip
> FROM functional.jointbl
> FULL OUTER JOIN
> functional.testtbl
> ON jointbl.test_id = testtbl.id
> FULL OUTER JOIN
> functional.dimtbl
> ON coalesce(jointbl.test_id, testtbl.id) = dimtbl.id
> WHERE
> `jointbl`.`test_zip` = 94611 and coalesce(`testtbl`.`zip`, 0) = 0;
>
> !image-2022-08-25-14-47-51-966.png!
> We can't push down the predicate 'coalesce(testtbl.zip, 0) = 0' to ScanNode
> since it is not null rejecting
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]