Riza Suminto has posted comments on this change. ( http://gerrit.cloudera.org:8080/21688 )
Change subject: IMPALA-13262: Do not always migrate inferred predicates into inline view ...................................................................... Patch Set 2: (1 comment) http://gerrit.cloudera.org:8080/#/c/21688/1/fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java File fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java: http://gerrit.cloudera.org:8080/#/c/21688/1/fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java@1567 PS1, Line 1567: or right side i > Thanks Riza! One tuple id represent one tuple row coming out from one scan node. Let say you have query like this: SELECT * FROM ( SELECT year, id, int_col, ROW_NUMBER() over(PARTITION BY year ORDER BY id DESC) rn FROM (select * from functional.alltypes UNION ALL select * from functional.alltypes) allt ) iv WHERE rn = 3650 AND iv.id = iv.int_col; In the query plan, you will see tuple 0 and 1 from SCAN node and tuple 2 from UNION node, like this: .... F02:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=160.19MB mem-reservation=32.00KB thread-reservation=2 00:UNION | pass-through-operands: all | mem-estimate=0B mem-reservation=0B thread-reservation=0 | tuple-ids=2 row-size=12B cardinality=1.46K | in pipelines: 01(GETNEXT), 02(GETNEXT) | |--02:SCAN HDFS [functional.alltypes, RANDOM] | HDFS partitions=24/24 files=24 size=478.45KB | predicates: functional.alltypes.id = functional.alltypes.int_col | stored statistics: | table: rows=7.30K size=478.45KB | partitions: 24/24 rows=7.30K | columns: all | extrapolated-rows=disabled max-scan-range-rows=310 | mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1 | tuple-ids=1 row-size=12B cardinality=730 | in pipelines: 02(GETNEXT) | 01:SCAN HDFS [functional.alltypes, RANDOM] HDFS partitions=24/24 files=24 size=478.45KB predicates: functional.alltypes.id = functional.alltypes.int_col stored statistics: table: rows=7.30K size=478.45KB partitions: 24/24 rows=7.30K columns: all extrapolated-rows=disabled max-scan-range-rows=310 mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1 tuple-ids=0 row-size=12B cardinality=730 in pipelines: 01(GETNEXT) Note that I get this before applying your patch, so both 01:SCAN and 02:SCAN still have pushed down predicate. -- To view, visit http://gerrit.cloudera.org:8080/21688 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I6e2632b3b1a140ae0104ceba4e2f474ac1bbcda1 Gerrit-Change-Number: 21688 Gerrit-PatchSet: 2 Gerrit-Owner: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Comment-Date: Tue, 20 Aug 2024 22:17:35 +0000 Gerrit-HasComments: Yes
