[
https://issues.apache.org/jira/browse/NUTCH-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588976#comment-14588976
]
Sujen Shah commented on NUTCH-2039:
-----------------------------------
Thanks [~lewismc], [~wastl-nagel] and [~chrismattmann] for your inputs.
I have updated the PR. The new one now includes
* An interface for a SimilarityModel to be plugged in.
* Moved CosineSimilarity to its own package implementing the new interface
* Caching the stop words
* Using LOG.error
Will update the wiki with instructions regarding the new plugin.
> Relevance based scoring filter
> ------------------------------
>
> Key: NUTCH-2039
> URL: https://issues.apache.org/jira/browse/NUTCH-2039
> Project: Nutch
> Issue Type: New Feature
> Reporter: Sujen Shah
> Assignee: Lewis John McGibbney
> Labels: memex, nutch
> Fix For: 1.11
>
>
> A ScoringFilter plugin that uses a similarity measure to calculate the
> similarity between a given page(gold standard) and the currently parsed page.
> The score obtained from this similarity is then distributed to its outlinks.
> This filter aims to focus the crawler to crawl/explore relevant pages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
