[
https://issues.apache.org/jira/browse/NUTCH-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734998#comment-15734998
]
ASF GitHub Bot commented on NUTCH-2337:
---------------------------------------
GitHub user sebastian-nagel opened a pull request:
https://github.com/apache/nutch/pull/160
NUTCH-2337 urlnormalizer-basic to strip empty port
- make sure that URLs which contain anything else than the host
in the authority (incl. empty port) are marked as changed
- always use root locale for case conversion
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sebastian-nagel/nutch
NUTCH-2337-basic-url-normalizer-empty-port
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nutch/pull/160.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #160
----
commit 48918afc9cee8d8142624e511e822f7e70f31565
Author: Sebastian Nagel <[email protected]>
Date: 2016-12-09T10:45:54Z
NUTCH-2337 urlnormalizer-basic to strip empty port
- make sure that URLs which contain anything else than the host
in the authority (incl. empty port) are marked as changed
- always use root locale for case conversion
----
> urlnormalizer-basic to strip empty port
> ---------------------------------------
>
> Key: NUTCH-2337
> URL: https://issues.apache.org/jira/browse/NUTCH-2337
> Project: Nutch
> Issue Type: Bug
> Components: plugin
> Affects Versions: 1.12
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Minor
> Fix For: 1.13
>
>
> Basic URL normalizer should strip an empty port from the URL, that's not the
> case at present:
> {noformat}
> echo "http://example.com:/"; \
> | nutch plugin urlnormalizer-basic
> org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
> http://example.com:/
> {noformat}
> The result should be {{http://example.com/}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
