[
https://issues.apache.org/jira/browse/HIVE-24650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhaojk updated HIVE-24650:
--------------------------
Description:
HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and
when the memory is full, there will be frequent Full GC, and then the memory
cannot be recycled, resulting in a service exception.Analyze memory usage.
GC config:
export HADOOP_OPTS="$HADOOP_OPTS
-Xloggc:\{{hive_log_dir}}/hiveserver2-gc-%t.log -XX:ConcGCThreads=30
-XX:ParallelGCThreads=30 -XX:+UseG1GC -XX:G1HeapRegionSize=8M
-XX:+UseStringDeduplication -XX:MaxGCPauseMillis=1000
-XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=15
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCCause
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M
-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hive/hs2_heapdump.hprof
-Dhive.log.dir=\{{hive_log_dir}} -Dhive.log.file=hiveserver2.log
The details at
[https://blog.csdn.net/Small_codeing/article/details/112601226]
was:
HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and
when the memory is full, there will be frequent Full GC, and then the memory
cannot be recycled, resulting in a service exception.Analyze memory usage.The
details at
https://blog.csdn.net/Small_codeing/article/details/112601226
> hiveserver2 memory usage is extremely high, GC unable to recycle
> ----------------------------------------------------------------
>
> Key: HIVE-24650
> URL: https://issues.apache.org/jira/browse/HIVE-24650
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.1.0
> Environment: hive3.1.0
> Reporter: zhaojk
> Priority: Major
> Attachments: 1.png, 2.png, 3.png
>
>
> HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and
> when the memory is full, there will be frequent Full GC, and then the memory
> cannot be recycled, resulting in a service exception.Analyze memory usage.
> GC config:
> export HADOOP_OPTS="$HADOOP_OPTS
> -Xloggc:\{{hive_log_dir}}/hiveserver2-gc-%t.log -XX:ConcGCThreads=30
> -XX:ParallelGCThreads=30 -XX:+UseG1GC -XX:G1HeapRegionSize=8M
> -XX:+UseStringDeduplication -XX:MaxGCPauseMillis=1000
> -XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=15
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCCause
> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M
> -XX:+HeapDumpOnOutOfMemoryError
> -XX:HeapDumpPath=/home/hive/hs2_heapdump.hprof
> -Dhive.log.dir=\{{hive_log_dir}} -Dhive.log.file=hiveserver2.log
> The details at
> [https://blog.csdn.net/Small_codeing/article/details/112601226]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
