[
https://issues.apache.org/jira/browse/NUTCH-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrzej Bialecki closed NUTCH-167.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.9.0
Assignee: Andrzej Bialecki
Patch applied with minor changes, rev. 515844.
> Observation of <META NAME="ROBOTS" CONTENT="NOARCHIVE"> directive
> -----------------------------------------------------------------
>
> Key: NUTCH-167
> URL: https://issues.apache.org/jira/browse/NUTCH-167
> Project: Nutch
> Issue Type: Improvement
> Components: indexer, web gui
> Affects Versions: 0.7.1
> Reporter: Ed Whittaker
> Assigned To: Andrzej Bialecki
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments: patch.txt
>
>
> Though not strictly a bug, this issue is potentially serious for users of
> Nutch who deploy live systems who might be threatened with legal action for
> caching copies of copyrighted material. The major search engines all observe
> this directive (even though apparently it's not stanard) so there's every
> reason why Nutch should too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
