[
https://issues.apache.org/jira/browse/HIVE-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804885#comment-14804885
]
WangMeng commented on HIVE-11149:
---------------------------------
[~sershe] I know PerfLogger is threadlocal, but in current environment, some
times Hive Client's Java Process will hang at "
java.util.HashMap.put(HashMap.java:494) "and never exit.
such as the following:
"main" prio=10 tid=0x00007f938c014800 nid=0x4e1a runnable [0x00007f9392f3c000]
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.put(HashMap.java:494)
at org.apache.hadoop.hive.ql.log.PerfLogger.PerfLogBegin(PerfLogger.java:109)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1282)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1101)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:924)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:914)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:269)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:221)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:431)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:367)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:750)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:694)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:633)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> Fix issue with Thread unsafe Class HashMap in PerfLogger.java hangs in
> Multi-thread environment
> ---------------------------------------------------------------------------------------------------
>
> Key: HIVE-11149
> URL: https://issues.apache.org/jira/browse/HIVE-11149
> Project: Hive
> Issue Type: Bug
> Components: Logging
> Affects Versions: 1.2.0
> Reporter: WangMeng
> Assignee: WangMeng
> Attachments: HIVE-11149.01.patch, HIVE-11149.02.patch
>
>
> In Multi-thread environment, the Thread unsafe Class HashMap in
> PerfLogger.java will casue massive Java Processes hang and cost large
> amounts of unnecessary CPU and Memory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
