Sebastian Nagel created NUTCH-2803:
--------------------------------------

             Summary: Rename property http.robot.rules.whitelist
                 Key: NUTCH-2803
                 URL: https://issues.apache.org/jira/browse/NUTCH-2803
             Project: Nutch
          Issue Type: Sub-task
          Components: configuration, robots
            Reporter: Sebastian Nagel
             Fix For: 1.18


As part of NUTCH-2802 the property {{http.robot.rules.whitelist}} should be 
renamed.

See the [definition of 
http.robot.rules.whitelist|http://nutch.apache.org/apidocs/apidocs-1.17/resources/nutch-default.xml#http.robot.rules.whitelist]:

bq. Comma separated list of hostnames or IP addresses to ignore robot rules 
parsing for. Use with care and only if you are explicitly allowed by the site 
owner to ignore the site's robots.txt!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to