[
https://issues.apache.org/jira/browse/NUTCH-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel resolved NUTCH-2803.
------------------------------------
Fix Version/s: 1.18
(was: 1.19)
Resolution: Fixed
Resolving as the associated pull request was merged in 2021 and the fix is
included in Nutch 1.18
> Rename property http.robot.rules.whitelist
> ------------------------------------------
>
> Key: NUTCH-2803
> URL: https://issues.apache.org/jira/browse/NUTCH-2803
> Project: Nutch
> Issue Type: Sub-task
> Components: configuration, robots
> Reporter: Sebastian Nagel
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.18
>
>
> As part of NUTCH-2802 the property {{http.robot.rules.whitelist}} should be
> renamed.
> See the [definition of
> http.robot.rules.whitelist|http://nutch.apache.org/apidocs/apidocs-1.17/resources/nutch-default.xml#http.robot.rules.whitelist]:
> bq. Comma separated list of hostnames or IP addresses to ignore robot rules
> parsing for. Use with care and only if you are explicitly allowed by the site
> owner to ignore the site's robots.txt!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
