[
https://issues.apache.org/jira/browse/IMPALA-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18044349#comment-18044349
]
weihua zhang edited comment on IMPALA-14622 at 12/11/25 5:59 AM:
-----------------------------------------------------------------
duckdb use 10s
{code:java}
┌──────────────┬───────────────┬─────────────────────────┬─────────────────────────┬────────────────────────────────────┬────────────────────────────────────┬─────────────────────────────┬─────────────────────────────┬─────────────────────────────┐
│ feature_name │ feature_value │ mask1_temp_table_6_col1 │
mask2_temp_table_6_col1 │ round((mask1_percentage * 100), 2) │
round((mask2_percentage * 100), 2) │ round(temp_table_8_col1, 2) │
round(temp_table_8_col2, 2) │ round(temp_table_8_col3, 2) │
│ varchar │ int32 │ int64 │ int64
│ double │ double │
double │ double │ double
│
├──────────────┴───────────────┴─────────────────────────┴─────────────────────────┴────────────────────────────────────┴────────────────────────────────────┴─────────────────────────────┴─────────────────────────────┴─────────────────────────────┤
│
0 rows
│
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Run Time (s): real 10.080 user 10.209553 sys 0.303115
{code}
was (Author: JIRAUSER307426):
duckdb use 10s
{code:java}
┌──────────────┬───────────────┬─────────────────────────┬─────────────────────────┬────────────────────────────────────┬────────────────────────────────────┬─────────────────────────────┬─────────────────────────────┬─────────────────────────────┐
│ feature_name │ feature_value │ mask1_temp_table_6_col1 │
mask2_temp_table_6_col1 │ round((mask1_percentage * 100), 2) │
round((mask2_percentage * 100), 2) │ round(temp_table_8_col1, 2) │
round(temp_table_8_col2, 2) │ round(temp_table_8_col3, 2) │
│ varchar │ int32 │ int64 │ int64
│ double │ double │
double │ double │ double
│
├──────────────┴───────────────┴─────────────────────────┴─────────────────────────┴────────────────────────────────────┴────────────────────────────────────┴─────────────────────────────┴─────────────────────────────┴─────────────────────────────┤
│
0 rows
│
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Run Time (s): real 10.080 user 10.209553 sys 0.303115
{code}
> Multi sub-query and union all in one query cause coordinator jvm oom
> --------------------------------------------------------------------
>
> Key: IMPALA-14622
> URL: https://issues.apache.org/jira/browse/IMPALA-14622
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.3.0
> Reporter: Weizisheng
> Priority: Major
> Attachments: demo.sql
>
>
> With demo.sql attached, coordinator will run out of heap memory of the
> coordinator process.
> The following log brushing in impalad.INFO
> {code:java}
> I1209 11:00:20.028505 2072263 MetastoreShim.java:655]
> e449e840948f713e:fb6ff8ba00000000] Table
> demo_table_1210,#bucket=-1,isBucketed:false,tableType=MANAGED_TABLE,tableCapabilities=null{code}
> And eventually, coordinator aborted.
> {code:java}
> I1209 11:04:38.965866 3295030 JvmPauseMonitor.java:209] Detected pause in JVM
> or host machine (eg GC): pause of approximately 5679ms
> GC pool 'G1 Young Generation' had collection(s): count=1 time=6045ms
> I1209 11:05:33.816803 4099651 impala-server.cc:1363] Found local timezone
> "Asia/Shanghai".
> I1209 11:05:47.246533 3295030 JvmPauseMonitor.java:209] Detected pause in JVM
> or host machine (eg GC): pause of approximately 5468ms
> GC pool 'G1 Young Generation' had collection(s): count=4 time=14537ms
> GC pool 'G1 Old Generation' had collection(s): count=1 time=53666ms
> OOM caused by java heap space occurred, allocate size: 376 bytes, type:
> Ljava/lang/Thread;
> garbage-first heap total 31424512K, used 31369210K [0x0000000082000000,
> 0x0000000800000000)
> region size 16384K, 0 young (0K), 0 survivors (0K)
> Metaspace used 72157K, capacity 72727K, committed 73908K, reserved
> 1116160K
> class space used 6947K, capacity 7159K, committed 7296K, reserved
> 1048576K
> current stack trace:
> F1209 11:33:31.436828 5235 jni-util.cc:241]
> fc45f25066e555ad:4b2c8b5c00000000] Check failed: rc == 0 (-2 vs. 0) Unable to
> get JVM {code}
> It happens for coordinator both with -Xmx8G and -Xmx32G.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
