[ http://issues.apache.org/jira/browse/NUTCH-242?page=comments#action_12372620 ]
Rod Taylor commented on NUTCH-242: ---------------------------------- Sorry. I cannot mark the first patch as being invalid and neglected to use a version number. v2 is named nutch_urlfilter.patch > Add optional -urlFiltering to updatedb > -------------------------------------- > > Key: NUTCH-242 > URL: http://issues.apache.org/jira/browse/NUTCH-242 > Project: Nutch > Type: New Feature > Versions: 0.8-dev > Reporter: Rod Taylor > Attachments: nutch_crawldb_filtering.patch, nutch_urlfilter.patch > > Allow filtering the URLs completely out of the database during an updatedb > run. This allows the regex-urlfilter.xml rules to be changed and the > non-matching entries to be expunged from the database. > Merging the functionality with updatedb was done for efficiency reasons since > this eats up CPU time only where a separate job would use IO and CPU time. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
