[ 
https://issues.apache.org/jira/browse/IMPALA-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18053763#comment-18053763
 ] 

weihua zhang commented on IMPALA-14622:
---------------------------------------

[~MikaelSmith] still slow with your fixes

> Multi sub-query and union all in one query cause coordinator jvm oom
> --------------------------------------------------------------------
>
>                 Key: IMPALA-14622
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14622
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>    Affects Versions: Impala 4.3.0
>            Reporter: Weizisheng
>            Priority: Major
>         Attachments: demo.sql, image-2025-12-11-15-19-04-753.png
>
>
> With demo.sql attached, coordinator will run out of heap memory of the 
> coordinator process.
> The following log brushing in impalad.INFO 
> {code:java}
> I1209 11:00:20.028505 2072263 MetastoreShim.java:655] 
> e449e840948f713e:fb6ff8ba00000000] Table 
> demo_table_1210,#bucket=-1,isBucketed:false,tableType=MANAGED_TABLE,tableCapabilities=null{code}
> And eventually, coordinator aborted.
> {code:java}
> I1209 11:04:38.965866 3295030 JvmPauseMonitor.java:209] Detected pause in JVM 
> or host machine (eg GC): pause of approximately 5679ms
> GC pool 'G1 Young Generation' had collection(s): count=1 time=6045ms
> I1209 11:05:33.816803 4099651 impala-server.cc:1363] Found local timezone 
> "Asia/Shanghai".
> I1209 11:05:47.246533 3295030 JvmPauseMonitor.java:209] Detected pause in JVM 
> or host machine (eg GC): pause of approximately 5468ms
> GC pool 'G1 Young Generation' had collection(s): count=4 time=14537ms
> GC pool 'G1 Old Generation' had collection(s): count=1 time=53666ms
> OOM caused by java heap space occurred, allocate size: 376 bytes, type: 
> Ljava/lang/Thread;
>  garbage-first heap   total 31424512K, used 31369210K [0x0000000082000000, 
> 0x0000000800000000)
>   region size 16384K, 0 young (0K), 0 survivors (0K)
>  Metaspace       used 72157K, capacity 72727K, committed 73908K, reserved 
> 1116160K
>   class space    used 6947K, capacity 7159K, committed 7296K, reserved 
> 1048576K
> current stack trace:
> F1209 11:33:31.436828  5235 jni-util.cc:241] 
> fc45f25066e555ad:4b2c8b5c00000000] Check failed: rc == 0 (-2 vs. 0) Unable to 
> get JVM {code}
> It happens for coordinator both with -Xmx8G and -Xmx32G.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to