[
https://issues.apache.org/jira/browse/NUTCH-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18046165#comment-18046165
]
Hudson commented on NUTCH-3136:
-------------------------------
SUCCESS: Integrated in Jenkins build Nutch ยป Nutch-trunk #210 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/210/])
NUTCH-3136 Upgrade crawler-commons dependency (snagel:
[https://github.com/apache/nutch/commit/50b1ee63918d264c2064120282185a14d88209f3])
* (edit) src/java/org/apache/nutch/fetcher/FetcherThread.java
* (edit) ivy/ivy.xml
* (edit) src/java/org/apache/nutch/protocol/Protocol.java
* (edit) src/java/org/apache/nutch/util/URLUtil.java
* (edit)
src/plugin/protocol-file/src/java/org/apache/nutch/protocol/file/File.java
* (edit) src/plugin/protocol-ftp/src/java/org/apache/nutch/protocol/ftp/Ftp.java
* (edit)
src/plugin/lib-http/src/java/org/apache/nutch/protocol/http/api/HttpBase.java
NUTCH-3136 Upgrade crawler-commons dependency (snagel:
[https://github.com/apache/nutch/commit/c7cf56964e4f901510d2a795213c6e649b8cc3b7])
* (edit) src/test/org/apache/nutch/util/TestURLUtil.java
> Upgrade crawler-commons dependency
> ----------------------------------
>
> Key: NUTCH-3136
> URL: https://issues.apache.org/jira/browse/NUTCH-3136
> Project: Nutch
> Issue Type: Improvement
> Components: dependency, robots, sitemap, util
> Affects Versions: 1.22
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.22
>
>
> Crawler-commons
> [1.6|https://github.com/crawler-commons/crawler-commons/releases/tag/crawler-commons-1.6]
> has been released recently, the last upgrade of the crawler-commons
> dependency was to 1.4 in NUTCH-2995.
> The upgrade should also include the switch to methods of the Robots parser,
> taking URL objects as parameters and such avoiding repeatedly parsing of URLs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
