[ https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588544#comment-14588544 ]
Chris A. Mattmann commented on NUTCH-2038: ------------------------------------------ Hi Lewis, there is no reason this can't be a URLFilter either. Asitang please continue working on the URL filter. no reason we can't do at inject time with a filter, and/or output from parsing too. > url filter that uses a model (from a classifier) > ------------------------------------------------- > > Key: NUTCH-2038 > URL: https://issues.apache.org/jira/browse/NUTCH-2038 > Project: Nutch > Issue Type: New Feature > Components: fetcher, injector, parser > Reporter: Asitang Mishra > Assignee: Chris A. Mattmann > Labels: memex, nutch > Fix For: 1.11 > > > A url filter that will filter out the urls (after the parsing stage, will > keep only those urls that contain some "hot words" provided again in a list.) > from that pages that are classified irrelevant by the classifier (using a > model provided). -- This message was sent by Atlassian JIRA (v6.3.4#6332)