[
https://issues.apache.org/jira/browse/NUTCH-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150747#comment-14150747
]
Ameer Tawfik Albaham commented on NUTCH-1403:
---------------------------------------------
I would like to contribute to this issue. However, I am a bit not sure what
else is required in addition to what *urlmeta* is doing. Does this plugin have
a different list of meta data for each case:
- a list of meta data to pass from crawl datum to content.
- a list of meta data to pass from content to parse data.
- a list of meta data to pass from parse data to outlinks.
- a list of meta data to pass from crawl datum to content to parse data.
> Add default ScoringFilter for manipulating metadata
> ----------------------------------------------------
>
> Key: NUTCH-1403
> URL: https://issues.apache.org/jira/browse/NUTCH-1403
> Project: Nutch
> Issue Type: Improvement
> Reporter: Julien Nioche
>
> This is currently done by the urlmeta plugin, which has too vague a name and
> a redundant indexing filter now that we have the index-metadata plugin. This
> scoring filter would help defining which metadata to pass from :
> - the crawl metadata to the content metadata
> - the content metadata to the parse metadata
> - the parse metadata to the crawldatum for the outlinks
> I'd make this scoring filter available by default i.e. not in a separate
> plugin as its functionalities are commonly used.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
