[ 
https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782587#comment-13782587
 ] 

Thejas M Nair commented on HIVE-4501:
-------------------------------------

I reviewed the patch. The patch seems to make an assumption that same thread is 
used for whole session. This is not the case, same thread can get used for 
another session, once the call for a session has been serviced. This will close 
FileSystems associated with other sessions as well.

A clean way to deal with this would be to use same way as its done for 
impersonation in kerberos mode, ie using HiveSessionImplwithUGI .


> HS2 memory leak - FileSystem objects in FileSystem.CACHE
> --------------------------------------------------------
>
>                 Key: HIVE-4501
>                 URL: https://issues.apache.org/jira/browse/HIVE-4501
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 0.11.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>            Priority: Critical
>         Attachments: HIVE-4501.1.patch, HIVE-4501.1.patch, HIVE-4501.1.patch, 
> HIVE-4501.trunk.patch
>
>
> org.apache.hadoop.fs.FileSystem objects are getting accumulated in 
> FileSystem.CACHE, with HS2 in unsecure mode.
> As a workaround, it is possible to set fs.hdfs.impl.disable.cache and 
> fs.file.impl.disable.cache to true.
> Users should not have to bother with this extra configuration. 
> As a workaround disable impersonation by setting hive.server2.enable.doAs to 
> false.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to