Jinglun created HADOOP-15565:
--------------------------------
Summary: ViewFileSystem.close doesn't close child filesystems and
causes FileSystem objects leak.
Key: HADOOP-15565
URL: https://issues.apache.org/jira/browse/HADOOP-15565
Project: Hadoop Common
Issue Type: Bug
Reporter: Jinglun
When we create a ViewFileSystem, all it's child filesystems will be cached by
FileSystem.CACHE. Unless we close these child filesystems, they will stay in
FileSystem.CACHE forever.
I think we should let FileSystem.CACHE cache ViewFileSystem only, and let
ViewFileSystem cache all it's child filesystems. So we can close ViewFileSystem
without leak and won't affect other ViewFileSystems.
I find this problem because i need to re-login my kerberos and renew
ViewFileSystem periodically. Because FileSystem.CACHE.Key is based on
UserGroupInformation, which changes everytime i re-login, I can't use the
cached child filesystems when i new a ViewFileSystem. And because
ViewFileSystem.close does nothing but remove itself from cache, i leak all it's
child filesystems in cache.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
