[
https://issues.apache.org/jira/browse/NUTCH-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060084#comment-13060084
]
Markus Jelsma commented on NUTCH-1011:
--------------------------------------
Most likely not but i will look in to it and make sure it does.
> Normalize duplicate slashes in URL's
> ------------------------------------
>
> Key: NUTCH-1011
> URL: https://issues.apache.org/jira/browse/NUTCH-1011
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.4, 2.0
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.4, 2.0
>
> Attachments: NUTCH-1011-all-3.patch
>
>
> Many websites produce faulty URL's with multiple slashes e.g.
> http://cocoon.apache.org///////////////////////1.x/dynamic.html
> This can be really nasty if the number of slashes varies, resulting in many
> URL's actually pointing to the same page and generating new (unique) URL's to
> the same or other duplicate pages.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
