[
https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609555#comment-14609555
]
Hudson commented on NUTCH-2038:
-------------------------------
FAILURE: Integrated in Nutch-trunk #3184 (See
[https://builds.apache.org/job/Nutch-trunk/3184/])
Updates to make tests pass related to NUTCH-2038: Naive Bayes classifier based
html Parse filter (for filtering outlinks) this closes #42. (mattmann:
http://svn.apache.org/viewvc/nutch/trunk/?view=rev&rev=1688549)
* /nutch/trunk/conf/naivebayes-train.txt.template
* /nutch/trunk/conf/naivebayes-wordlist.txt.template
* /nutch/trunk/conf/nutch-default.xml
* /nutch/trunk/default.properties
* /nutch/trunk/ivy/ivy.xml
* /nutch/trunk/src/plugin/parsefilter-naivebayes/ivy.xml
> Naive Bayes classifier based html Parse filter (for filtering outlinks)
> -----------------------------------------------------------------------
>
> Key: NUTCH-2038
> URL: https://issues.apache.org/jira/browse/NUTCH-2038
> Project: Nutch
> Issue Type: New Feature
> Components: fetcher, injector, parser
> Reporter: Asitang Mishra
> Assignee: Chris A. Mattmann
> Labels: memex, nutch
> Fix For: 1.11
>
>
> A html parse filter that will filter out the outlinks in two stages.
> Classify the parse text and decide if the parent page is relevant. If
> relevant then don't filter the outlinks. If irrelevant then go thru each
> outlink and see if the url contains any of the important words from a list.
> If it does then let it pass.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
