[
https://issues.apache.org/jira/browse/NUTCH-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826958#comment-15826958
]
Sebastian Nagel commented on NUTCH-2349:
----------------------------------------
See also
[crawler-commons#136|https://github.com/crawler-commons/crawler-commons/pull/136].
If there are no objections, I'll commit this fix on 1.x and 2.x. Thanks!
> urlnormalizer-basic NPE for ill-formed URL "http:/"
> ---------------------------------------------------
>
> Key: NUTCH-2349
> URL: https://issues.apache.org/jira/browse/NUTCH-2349
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 2.4, 1.13
> Reporter: Sebastian Nagel
> Fix For: 2.4, 1.13
>
>
> NUTCH-2337 introduced a potential (though rare) NullPointerException when an
> ill-formed URL (just the protocol followed by "{{:}}", "{{:/}}", "{{:////}}"
> or even more slashes):
> {noformat}
> % echo "http://///"; \
> | runtime/local/bin/nutch org.apache.nutch.net.URLNormalizerChecker \
> -normalizer org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
> Checking URLNormalizer
> org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer.normalize(BasicURLNormalizer.java:120)
> at
> org.apache.nutch.net.URLNormalizerChecker.checkOne(URLNormalizerChecker.java:72)
> at
> org.apache.nutch.net.URLNormalizerChecker.main(URLNormalizerChecker.java:110)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
