[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782587#comment-13782587 ]
Thejas M Nair commented on HIVE-4501: ------------------------------------- I reviewed the patch. The patch seems to make an assumption that same thread is used for whole session. This is not the case, same thread can get used for another session, once the call for a session has been serviced. This will close FileSystems associated with other sessions as well. A clean way to deal with this would be to use same way as its done for impersonation in kerberos mode, ie using HiveSessionImplwithUGI . > HS2 memory leak - FileSystem objects in FileSystem.CACHE > -------------------------------------------------------- > > Key: HIVE-4501 > URL: https://issues.apache.org/jira/browse/HIVE-4501 > Project: Hive > Issue Type: Bug > Components: HiveServer2 > Affects Versions: 0.11.0 > Reporter: Thejas M Nair > Assignee: Thejas M Nair > Priority: Critical > Attachments: HIVE-4501.1.patch, HIVE-4501.1.patch, HIVE-4501.1.patch, > HIVE-4501.trunk.patch > > > org.apache.hadoop.fs.FileSystem objects are getting accumulated in > FileSystem.CACHE, with HS2 in unsecure mode. > As a workaround, it is possible to set fs.hdfs.impl.disable.cache and > fs.file.impl.disable.cache to true. > Users should not have to bother with this extra configuration. > As a workaround disable impersonation by setting hive.server2.enable.doAs to > false. -- This message was sent by Atlassian JIRA (v6.1#6144)