[
https://issues.apache.org/jira/browse/HADOOP-14193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Miguel Arreola updated HADOOP-14193:
-----------------------------------------
Comment: was deleted
(was: [~aagarwal] i opened this ticket by mistake in HADOOP instead of YARN, so
i closed this as invalid, and created it in the right place in YARN, refer to
this issue: https://issues.apache.org/jira/browse/YARN-6358)
> Cache the resolved hosts to prevent calls to InetAddress.getByName and
> normalizeHost
> ------------------------------------------------------------------------------------
>
> Key: HADOOP-14193
> URL: https://issues.apache.org/jira/browse/HADOOP-14193
> Project: Hadoop Common
> Issue Type: Improvement
> Components: common
> Reporter: Jose Miguel Arreola
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When running performance tests, we noticed that a lot of time is taken in
> resolving the host address.
> In our specific scenario, we saw the function
> org.apache.hadoop.security.SecurityUtil.getInetAddressByName taking a lot of
> time to resolve the hosts, and the same function is called a lot of times.
> I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has
> a cached resolver already because of the same reason.
> So, the proposal is, to make this cache generic and use it to save some time
> in this functions that we already know, but have it available so the cache
> can be used anywhere else.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
