[
https://issues.apache.org/jira/browse/NUTCH-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532688#comment-16532688
]
Sebastian Nagel commented on NUTCH-2612:
----------------------------------------
Hi [~markus17], shouldn't it be {{key.toString().startsWith("http://";)}}
instead of {{"http://".equals(key.toString()}}?
{code}
else if (value instanceof Text) {
// Input can be sitemap URL or hostname
if ("http://".equals(key.toString()) || ...
{code}
> Support for sitemap processing by hostname
> ------------------------------------------
>
> Key: NUTCH-2612
> URL: https://issues.apache.org/jira/browse/NUTCH-2612
> Project: Nutch
> Issue Type: Improvement
> Components: sitemap
> Affects Versions: 1.14
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Major
> Fix For: 1.16
>
> Attachments: NUTCH-2612.patch
>
>
> Add support to sitemap processor for processing just hostnames. Similar to
> the mapper eating sitemap URL's, but then with BaseRobotRules finding the
> sitemap URL's itself.
> Will upload patch soon.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
