Noarchive urls are available via the cache link
-----------------------------------------------
Key: NUTCH-462
URL: https://issues.apache.org/jira/browse/NUTCH-462
Project: Nutch
Issue Type: Bug
Components: web gui
Reporter: Steve Severance
Fix For: 0.8.1
If a robots.txt file specifies a Noarchive statement then urls that or
contained as part of that path should not be available via the cached link.
For example Noarchive:/ means that no pages should be available via the cached
link.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.