He Xiaoqiao created HDFS-13234:
----------------------------------
Summary: Remove renew configuration instance in
ConfiguredFailoverProxyProvider and reduce memory footprint for client
Key: HDFS-13234
URL: https://issues.apache.org/jira/browse/HDFS-13234
Project: Hadoop HDFS
Issue Type: Improvement
Components: fs, ha, hdfs-client
Reporter: He Xiaoqiao
The memory footprint of #DFSClient is very considerable in some special
scenario since there are many #Configuration instances and occupy much memory
resource (In an extreme case, org.apache.hadoop.conf.Configuration occupies
over 600MB we meet under HDFS Federation an HA with QJM and there are dozens of
NameNodes). I think some new Configuration instance is not necessary. Such as
#ConfiguredFailoverProxyProvider initialization.
{code:java}
public ConfiguredFailoverProxyProvider(Configuration conf, URI uri,
Class<T> xface, HAProxyFactory<T> factory) {
this.xface = xface;
this.conf = new Configuration(conf);
......
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
