[
https://issues.apache.org/jira/browse/NUTCH-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363033#comment-17363033
]
Hudson commented on NUTCH-2868:
-------------------------------
SUCCESS: Integrated in Jenkins build Nutch ยป Nutch-trunk #36 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/36/])
NUTCH-2868 urlnormalizer-protocol fails with StringIndexOutOfBoundsException
(snagel:
[https://github.com/apache/nutch/commit/2702c6fc68e79a83ae393a820ab49040eecb1934])
* (edit)
src/plugin/urlnormalizer-protocol/src/java/org/apache/nutch/net/urlnormalizer/protocol/ProtocolURLNormalizer.java
* (edit) src/plugin/urlnormalizer-protocol/data/protocols.txt
* (edit)
src/plugin/urlnormalizer-protocol/src/test/org/apache/nutch/net/urlnormalizer/protocol/TestProtocolURLNormalizer.java
> urlnormalizer-protocol fails with StringIndexOutOfBoundsException when
> reading invalid line in configuration file
> -----------------------------------------------------------------------------------------------------------------
>
> Key: NUTCH-2868
> URL: https://issues.apache.org/jira/browse/NUTCH-2868
> Project: Nutch
> Issue Type: Bug
> Components: plugin, urlnormalizer
> Affects Versions: 1.18
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Minor
> Fix For: 1.19
>
>
> When reading a invalid line in the configuration file, the protocol
> urlnormalizer may fail with a StringIndexOutOfBoundsException:
> {noformat}
> 2021-06-10 05:10:41,877 WARN [main] org.apache.hadoop.mapred.YarnChild:
> Exception running child : java.lang.StringIndexOutOfBoundsException: String
> index out of range: -1
> at java.lang.String.substring(String.java:1967)
> at
> org.apache.nutch.net.urlnormalizer.protocol.ProtocolURLNormalizer.readConfiguration(ProtocolURLNormalizer.java:95)
> at
> org.apache.nutch.net.urlnormalizer.protocol.ProtocolURLNormalizer.setConf(ProtocolURLNormalizer.java:182)
> {noformat}
> The invalid line should be logged and skipped without causing the job to fail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
