Sebastian Nagel created NUTCH-3230:
--------------------------------------

             Summary: protocol-okhttp: IP address filter to provide option to 
exclude more internal address spaces
                 Key: NUTCH-3230
                 URL: https://issues.apache.org/jira/browse/NUTCH-3230
             Project: Nutch
          Issue Type: Bug
          Components: plugin, protocol
    Affects Versions: 1.23
            Reporter: Sebastian Nagel
             Fix For: 1.24


The three keywords provided for the configuration property 
{{http.filter.ipaddress.exclude}} (localhost, loopback, sitelocal - see 
NUTCH-2930) do not cover all "internal" IP address ranges. It should be easy to 
exclude all "internal" ranges.

See [stormcrawler#2086|https://github.com/apache/stormcrawler/issues/2086] for 
further details.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to