amith created HDFS-3545: --------------------------- Summary: DFSClient leak due to malfunctioning of FileSystem Cache Key: HDFS-3545 URL: https://issues.apache.org/jira/browse/HDFS-3545 Project: Hadoop HDFS Issue Type: Bug Components: hdfs client Affects Versions: 2.0.0-alpha, 3.0.0 Reporter: amith
For every FileSystem.get new FileSystem object is getting created even though the UGI object passed has same name. This is creating the lot of FileSystem objects and cached in FileSystem cache instead of using the same cached object . This is causing the Cache to grow in size causing OOME This behaviour can be seen in Mapred and Hive components also since they use FileSystem.get in the described fashion -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira