[
https://issues.apache.org/jira/browse/NUTCH-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151515#comment-14151515
]
Ameer Tawfik Albaham commented on NUTCH-1403:
---------------------------------------------
I have implemented it. I am currently writing test units. However, I made a
separate list for each of the three cases. In my work, I encountered cases
where I need to pass information from crawl datum to content or from parse data
to outlink. So, I felt the separation is necessary. Do you have any thoughts
regarding that?
> Add default ScoringFilter for manipulating metadata
> ----------------------------------------------------
>
> Key: NUTCH-1403
> URL: https://issues.apache.org/jira/browse/NUTCH-1403
> Project: Nutch
> Issue Type: Improvement
> Reporter: Julien Nioche
>
> This is currently done by the urlmeta plugin, which has too vague a name and
> a redundant indexing filter now that we have the index-metadata plugin. This
> scoring filter would help defining which metadata to pass from :
> - the crawl metadata to the content metadata
> - the content metadata to the parse metadata
> - the parse metadata to the crawldatum for the outlinks
> I'd make this scoring filter available by default i.e. not in a separate
> plugin as its functionalities are commonly used.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
