Outlink urls should be validated
--------------------------------

                 Key: NUTCH-505
                 URL: https://issues.apache.org/jira/browse/NUTCH-505
             Project: Nutch
          Issue Type: Improvement
            Reporter: Doğacan Güney
            Priority: Minor


See discussion here:
http://www.nabble.com/fetching-http%3A--www.variety.com-%3C-div%3E%3C-a%3E-tf3961692.html

Parse plugins may extract garbage urls from pages. We need a url validation 
system that tests these urls and filters out garbage.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to