[
https://issues.apache.org/jira/browse/NUTCH-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17841470#comment-17841470
]
ASF GitHub Bot commented on NUTCH-3044:
---------------------------------------
sebastian-nagel commented on PR #815:
URL: https://github.com/apache/nutch/pull/815#issuecomment-2080603546
> we could provide a TestGenerator#testNullHostInReducer test case
Good idea! Done, see 4729786.
> Generator: NPE when extracting the host part of a URL fails
> -----------------------------------------------------------
>
> Key: NUTCH-3044
> URL: https://issues.apache.org/jira/browse/NUTCH-3044
> Project: Nutch
> Issue Type: Bug
> Components: generator
> Affects Versions: 1.20
> Reporter: Sebastian Nagel
> Priority: Minor
> Fix For: 1.21
>
>
> When extracting the host part of a URL fails, the Generator job fails because
> of a NPE in the SelectorReducer. This issue is reproducible if the CrawlDb
> contains an malformed URL, for example, a URL with an unsupported scheme
> (smb://).
> {noformat}
> Caused by: java.lang.NullPointerException
> at
> org.apache.nutch.crawl.Generator$SelectorReducer.reduce(Generator.java:439)
> at
> org.apache.nutch.crawl.Generator$SelectorReducer.reduce(Generator.java:300)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
