[
https://issues.apache.org/jira/browse/NUTCH-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925660#comment-16925660
]
Sebastian Nagel commented on NUTCH-2612:
----------------------------------------
Double-checked it: the patch as of 2019-07-24 changes the variable name
"fromHostDb":
{noformat}
- long fromHostDb = job.getCounters().findCounter("Sitemap",
"sitemaps_from_hostdb").getValue();
+ long fromHostname = job.getCounters().findCounter("Sitemap",
"sitemaps_from_hostname").getValue();
{noformat}
but below the variable "fromHostDb" is still used:
{noformat}
- LOG.info("SitemapProcessor: Total sitemaps from HostDb: {}",
fromHostDb);
+ LOG.info("SitemapProcessor: Total sitemaps from host name: {}",
fromHostDb);
{noformat}
> Support for sitemap processing by hostname
> ------------------------------------------
>
> Key: NUTCH-2612
> URL: https://issues.apache.org/jira/browse/NUTCH-2612
> Project: Nutch
> Issue Type: Improvement
> Components: sitemap
> Affects Versions: 1.14
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Major
> Fix For: 1.16
>
> Attachments: NUTCH-2612.patch, NUTCH-2612.patch, NUTCH-2612.patch
>
>
> Add support to sitemap processor for processing just hostnames. Similar to
> the mapper eating sitemap URL's, but then with BaseRobotRules finding the
> sitemap URL's itself.
> Will upload patch soon.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
