[ https://issues.apache.org/jira/browse/HADOOP-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064899#comment-14064899 ]
Hudson commented on HADOOP-10840: --------------------------------- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1834 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1834/]) HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1611247) * /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt * /hadoop/common/trunk/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java * /hadoop/common/trunk/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/metrics/AzureFileSystemMetricsSystem.java * /hadoop/common/trunk/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/AzureBlobStorageTestAccount.java * /hadoop/common/trunk/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/NativeAzureFileSystemBaseTest.java > Fix OutOfMemoryError caused by metrics system in Azure File System > ------------------------------------------------------------------ > > Key: HADOOP-10840 > URL: https://issues.apache.org/jira/browse/HADOOP-10840 > Project: Hadoop Common > Issue Type: Bug > Components: metrics > Affects Versions: 2.4.1 > Reporter: shanyu zhao > Assignee: shanyu zhao > Fix For: 3.0.0 > > Attachments: HADOOP-10840.1.patch, HADOOP-10840.2.patch, > HADOOP-10840.patch > > > In Hadoop 2.x the Hadoop File System framework changed and no cache is > implemented (refer to HADOOP-6356). This means for every WASB access, a new > NativeAzureFileSystem is created, along which a Metrics source created and > added to MetricsSystemImpl. Over time the sources accumulated, eating memory > and causing Java OutOfMemoryError. > The fix is to utilize the unregisterSource() method added to MetricsSystem in > HADOOP-10839. -- This message was sent by Atlassian JIRA (v6.2#6252)