[
https://issues.apache.org/jira/browse/NUTCH-710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13912850#comment-13912850
]
Lewis John McGibbney commented on NUTCH-710:
--------------------------------------------
hi [~msertacturkel], by the looks of the patch attached, it requires to be
possibly extended to also cover parse-tika plugin as well as unit tests for
both plugins. That would probably be it I suppose. We can then port it to 1.X
API. If you were able to take this on it would be great.
> Support for rel="canonical" attribute
> -------------------------------------
>
> Key: NUTCH-710
> URL: https://issues.apache.org/jira/browse/NUTCH-710
> Project: Nutch
> Issue Type: New Feature
> Affects Versions: 1.1
> Reporter: Frank McCown
> Priority: Minor
> Fix For: 2.3, 1.8
>
> Attachments: canonical.patch
>
>
> There is a the new rel="canonical" attribute which is
> now being supported by Google, Yahoo, and Live:
> http://googlewebmastercentral.blogspot.com/2009/02/specify-your-canonical.html
> Adding support for this attribute value will potentially reduce the number of
> URLs crawled and indexed and reduce duplicate page content.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
