shanyu zhao created HADOOP-10840:
------------------------------------
Summary: Fix OutOfMemoryError caused by metrics system in Azure
File System
Key: HADOOP-10840
URL: https://issues.apache.org/jira/browse/HADOOP-10840
Project: Hadoop Common
Issue Type: Bug
Components: metrics
Affects Versions: 2.4.1
Reporter: shanyu zhao
Assignee: shanyu zhao
In Hadoop 2.x the Hadoop File System framework changed and no cache is
implemented (refer to HADOOP-6356). This means for every WASB access, a new
NativeAzureFileSystem is created, along which a Metrics source created and
added to MetricsSystemImpl. Over time the sources accumulated, eating memory
and causing Java OutOfMemoryError.
The fix is to utilize the unregisterSource() method added to MetricsSystem in
HADOOP-10839.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
