[ 
https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592089#comment-14592089
 ] 

Asitang Mishra edited comment on NUTCH-2038 at 6/18/15 4:53 PM:
----------------------------------------------------------------

There are three columns: 
1. "1" or "0", "1" for relevent and "0" for irrelevent
2. A unique ID (an integer, can be long). This is unique per line/row.
3. Text (text that will be used for training)

Each row will be considered a new "document" for the classifier.


was (Author: asitang):
There are three columns: 
1. "1" or "0", "1" for relevent and "0" for irrelevent
2. A unique ID (an integer, can be long). This is unique per line/row.
3. Text (text that will be used for training)

> Naive Bayes classifier based url filter
> ---------------------------------------
>
>                 Key: NUTCH-2038
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2038
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, injector, parser
>            Reporter: Asitang Mishra
>            Assignee: Chris A. Mattmann
>              Labels: memex, nutch
>             Fix For: 1.11
>
>
> A url filter that will filter out the urls (after the parsing stage,  will 
> keep only those urls that contain some "hot words" provided again in a list.) 
> from that pages that are classified irrelevant by the classifier.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to