[ 
https://issues.apache.org/jira/browse/NUTCH-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Emmanuel Joke updated NUTCH-522:
--------------------------------

    Attachment: NUTCH-522_v2.patch

Oops, my mistake. Please find an updated patch.

Actually I've a question: I check some url which contains some space and it has 
been validated. 
For instance: http://lucene.apache.org/jira/browse.jsp?itemid=500 &sort=up
A space between 500 and & has been accepted.
Is it normal ?

I really want to exclude thos kind of URL.

Beside, I've checked the latest version of UrlValidator on Jakarta project:
http://svn.apache.org/repos/asf/jakarta/commons/proper/validator/trunk/src/main/java/org/apache/commons/validator/UrlValidator.java

It includes an option to disallow FRAGMENTS. Why don't we have this version in 
nutch ?

> Use URLValidator in the Injector
> --------------------------------
>
>                 Key: NUTCH-522
>                 URL: https://issues.apache.org/jira/browse/NUTCH-522
>             Project: Nutch
>          Issue Type: Improvement
>          Components: injector
>            Reporter: Emmanuel Joke
>            Priority: Minor
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-522.patch, NUTCH-522_v2.patch
>
>
> Same as NUTCH-505, we should use the UrlValidator to check url in the Injector

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to