Jose Miguel Arreola created HADOOP-14193:
--------------------------------------------
Summary: Cache the resolved hosts prevent calls to
InetAddress.getByName and normalizeHost
Key: HADOOP-14193
URL: https://issues.apache.org/jira/browse/HADOOP-14193
Project: Hadoop Common
Issue Type: Improvement
Components: common
Reporter: Jose Miguel Arreola
When running performance tests, we noticed that a lot of time is taken in
resolving the host address.
In our specific scenario, we saw the function
org.apache.hadoop.security.SecurityUtil.getInetAddressByName taking a lot of
time to resolve the hosts, and the same function is called a lot of times.
I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has a
cached resolver already because of the same reason.
So, the proposal is, to make this cache generic and use it to save some time in
this functions that we already know, but have it available so the cache can be
used anywhere else.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
