Karen Coppage created HIVE-24858:
------------------------------------
Summary: UDFClassLoader leak in session HiveConf
Key: HIVE-24858
URL: https://issues.apache.org/jira/browse/HIVE-24858
Project: Hive
Issue Type: Bug
Reporter: Karen Coppage
Assignee: Karen Coppage
If a UDF jar has been registered in a session and a temporary function created
from it, when the session is closed its UDFClassLoader is not GC'd as it has
been leaked to the session's HiveConf object's cache. Since the ClassLoader is
not GC'd, the UDF jar's classes aren't GC'd from Metaspace. This can
potentially lead to Metaspace OOM.
Path to GC root is:
{code:java}
Class Name
| Shallow Heap | Retained
Heap
-------------------------------------------------------------------------------------------------------------------------------------------------------------------
contextClassLoader org.apache.hive.service.server.ThreadWithGarbageCleanup @
0x7164deb50 HiveServer2-Handler-Pool: Thread-72 Thread| 128 |
79,072
referent java.util.WeakHashMap$Entry @ 0x7164e67d0
| 40 |
824
'- [6] java.util.WeakHashMap$Entry[16] @ 0x71581aac0
| 80 |
5,056
'- table java.util.WeakHashMap @ 0x71580f510
| 48 |
6,920
'- CACHE_CLASSES class org.apache.hadoop.conf.Configuration @ 0x71580f3d8
| 64 |
74,528
-------------------------------------------------------------------------------------------------------------------------------------------------------------------
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
