[
https://issues.apache.org/jira/browse/NUTCH-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17315670#comment-17315670
]
Hudson commented on NUTCH-2859:
-------------------------------
SUCCESS: Integrated in Jenkins build Nutch ยป Nutch-trunk #31 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/31/])
NUTCH-2859: urlnormalizer-protocol: allow to normalize domains (snagel:
[https://github.com/apache/nutch/commit/081c826745356e041c6d4e9d3e3c96ae91eddd2b])
* (edit) conf/protocols.txt.template
* (edit)
src/plugin/urlnormalizer-protocol/src/test/org/apache/nutch/net/urlnormalizer/protocol/TestProtocolURLNormalizer.java
* (edit) src/plugin/urlnormalizer-protocol/data/protocols.txt
* (edit)
src/plugin/urlnormalizer-protocol/src/java/org/apache/nutch/net/urlnormalizer/protocol/ProtocolURLNormalizer.java
* (edit) conf/nutch-default.xml
* (add)
src/plugin/urlnormalizer-protocol/src/java/org/apache/nutch/net/urlnormalizer/protocol/package-info.java
> urlnormalizer-protocol: allow to normalize domains
> --------------------------------------------------
>
> Key: NUTCH-2859
> URL: https://issues.apache.org/jira/browse/NUTCH-2859
> Project: Nutch
> Issue Type: Improvement
> Components: plugin, urlnormalizer
> Affects Versions: 1.18
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.19
>
>
> The plugin urlnormalizer-protocol normalizes the URL protocol/scheme for a
> given list of hosts to the desired "normal" protocol (usually one of http or
> https). It would be handy to allow to specify domain names as well, so that
> all hosts/subdomains in a given domain are normalized.
> In order to stay backward-compatible this could be done by matching
> {{*.example.org}} as a pattern for all hosts or subdomains of the domain
> {{example.org}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
