Riza Suminto created IMPALA-11914:
-------------------------------------
Summary: EXPLAIN_LEVEL=VERBOSE is broken by join build fragment
(MT_DOP>0)
Key: IMPALA-11914
URL: https://issues.apache.org/jira/browse/IMPALA-11914
Project: IMPALA
Issue Type: Bug
Components: Frontend
Affects Versions: Impala 4.2.0
Reporter: Riza Suminto
Attachments: explain-verbose-tpcds-q12.txt
When running with MT_DOP>0, EXPLAIN_LEVEL=VERBOSE will produce broken explain
string on fragment consuming input from join build fragment.
{code:java}
| F00:PLAN FRAGMENT [RANDOM] hosts=2 instances=2
|
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB
thread-reservation=0 runtime-filters-memory=2.00MB
|
| Per-Instance Resources: mem-estimate=67.58MB mem-reservation=42.00MB
thread-reservation=1
|
| DATASTREAM SINK [FRAGMENT=F03, EXCHANGE=11, HASH(i_class)]
|
| | mem-estimate=1.58MB mem-reservation=0B thread-reservation=0
|
| 05:AGGREGATE [STREAMING]
|
| | output: sum(ws_ext_sales_price)
|
| | group by: i_item_id, i_item_desc, i_category, i_class, i_current_price
|
| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB
thread-reservation=0
|
| | tuple-ids=3 row-size=198B cardinality=215.82K
|
| | in pipelines: 00(GETNEXT)
|
| |
|
| 04:HASH JOIN [INNER JOIN, BROADCAST]
|
| | hash-table-id=00
|
| | hash predicates: ws_sold_date_sk = d_date_sk
|
| | fk/pk conjuncts: ws_sold_date_sk = d_date_sk
|
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB
thread-reservation=0
|
| | tuple-ids=0,1,2 row-size=232B cardinality=215.82K
|
| | in pipelines: 00(GETNEXT), 02(OPEN)
|
| |
|
| F05:PLAN FRAGMENT [RANDOM] hosts=2 instances=2
|
| Per-Instance Resources: mem-estimate=8.96MB mem-reservation=8.75MB
thread-reservation=1 runtime-filters-memory=1.00MB
|
| JOIN BUILD
|
| | join-table-id=00 plan-id=01 cohort-id=01
|
| | build expressions: d_date_sk
|
| | runtime filters: RF000[bloom] <- d_date_sk
|
| | mem-estimate=7.75MB mem-reservation=7.75MB spill-buffer=64.00KB
thread-reservation=0
|
| |
|
| 10:EXCHANGE [BROADCAST]
|
| mem-estimate=215.48KB mem-reservation=0B thread-reservation=0
|
| tuple-ids=2 row-size=26B cardinality=7.30K
|
| in pipelines: 02(GETNEXT)
|
| |
|
| 03:HASH JOIN [INNER JOIN, BROADCAST]
|
| | hash-table-id=01
|
| | hash predicates: ws_item_sk = i_item_sk
|
| | fk/pk conjuncts: ws_item_sk = i_item_sk
|
| | mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB
thread-reservation=0
|
| | tuple-ids=0,1 row-size=206B cardinality=215.82K
|
| | in pipelines: 00(GETNEXT), 01(OPEN)
|
| |
|
| F06:PLAN FRAGMENT [RANDOM] hosts=2 instances=2
|
| Per-Instance Resources: mem-estimate=13.67MB mem-reservation=12.50MB
thread-reservation=1 runtime-filters-memory=1.00MB
|
| JOIN BUILD
|
| | join-table-id=01 plan-id=02 cohort-id=01
|
| | build expressions: i_item_sk
|
| | runtime filters: RF002[bloom] <- i_item_sk
|
| | mem-estimate=11.50MB mem-reservation=11.50MB spill-buffer=128.00KB
thread-reservation=0
|
| |
|
| 09:EXCHANGE [BROADCAST]
|
| mem-estimate=1.17MB mem-reservation=0B thread-reservation=0
|
| tuple-ids=1 row-size=190B cardinality=5.40K
|
| in pipelines: 01(GETNEXT)
|
| |
|
| 00:SCAN HDFS [tpcds_parquet.web_sales, RANDOM]
|
| HDFS partitions=1/1 files=2 size=45.09MB
|
| runtime filters: RF000[bloom] -> ws_sold_date_sk, RF002[bloom] ->
ws_item_sk
|
| stored statistics:
|
| table: rows=719.38K size=45.09MB
|
| columns: all
|
| extrapolated-rows=disabled max-scan-range-rows=644.77K
|
| file formats: [PARQUET]
|
| mem-estimate=32.00MB mem-reservation=8.00MB thread-reservation=0
|
| tuple-ids=0 row-size=16B cardinality=719.38K
|
| in pipelines: 00(GETNEXT)
| {code}
F00 should not print F05 and F06 within it. Attached is the full explain output.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
