[
https://issues.apache.org/jira/browse/NUTCH-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758785#action_12758785
]
Mike Baranczak commented on NUTCH-755:
--------------------------------------
Update: this class also chokes on legal URLs that specify the port number, like:
http://localhost:9999/
> DomainURLFilter crashes on malformed URL
> ----------------------------------------
>
> Key: NUTCH-755
> URL: https://issues.apache.org/jira/browse/NUTCH-755
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 1.0.0
> Environment: Tomcat 6.0.14
> Java 1.6.0_14
> Linux
> Reporter: Mike Baranczak
>
> 2009-09-16 21:54:17,001 ERROR [Thread-156] DomainURLFilter - Could not apply
> filter on url: http:/comments.php
> java.lang.NullPointerException
> at
> org.apache.nutch.urlfilter.domain.DomainURLFilter.filter(DomainURLFilter.java:173)
> at org.apache.nutch.net.URLFilters.filter(URLFilters.java:88)
> at
> org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:200)
> at
> org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:113)
> at
> org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:96)
> at
> org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:70)
> at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410)
> at
> org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:170)
> Expected behavior would be to recognize the URL as malformed, and reject it.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
