[
https://issues.apache.org/jira/browse/NUTCH-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma closed NUTCH-113.
-------------------------------
Resolution: Won't Fix
Bulk close of legacy issues:
http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira
> Disable permanent DNS-to-IP caching for JVM 1.4
> -----------------------------------------------
>
> Key: NUTCH-113
> URL: https://issues.apache.org/jira/browse/NUTCH-113
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Affects Versions: 0.7.2, 0.8
> Reporter: Fuad Efendi
> Priority: Trivial
>
> DNS-to-IP mapping may change during long crawls, by default JVM 1.4 caches it
> forever.
> Some related discussions at Jakarta-HttpClient-User
> http://mail-archives.apache.org/mod_mbox/jakarta-httpclient-user/200506.mbox/%3c20050627022440.SVIL13442.lakermmtao05.cox.net@zeus%3e
> http://java.sun.com/j2se/1.4.2/docs/guide/net/properties.html
> networkaddress.cache.ttl (default: -1)
> Specified in java.security to indicate the caching policy for successful
> name lookups from the name service.. The value is specified as as integer to
> indicate the number of seconds to cache the successful lookup.
> A value of -1 indicates "cache forever".
> We probably need this code in org.apache.nutch.fetcher.Fetcher:
> private static final int FETCHER_DNS_TTL_MINUTES =
> NutchConf.get().getInt("fetcher.dns.ttl.minutes", 120);
> static {
> java.security.Security.setProperty("networkaddress.cache.ttl", "" +
> FETCHER_DNS_TTL_MINUTES*60);
> }
> And, new property in nutch-default.xml:
> <property>
> <name>fetcher.dns.ttl.minutes</name>
> <value>120</value>
> <description>DNS-to-IP cache, Time-to-Live</description>
> </property>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
