[
https://issues.apache.org/jira/browse/NUTCH-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel resolved NUTCH-1380.
------------------------------------
Fix Version/s: (was: 1.19)
Resolution: Fixed
Verified that this was fixed by NUTCH-2375: the logs of fetcher reduce tasks do
not contain any messages regarding loading of URL filters/normalizers while the
fetcher map logs do.
> Fetcher reducer not to configure filter/normalizers
> ---------------------------------------------------
>
> Key: NUTCH-1380
> URL: https://issues.apache.org/jira/browse/NUTCH-1380
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Affects Versions: 1.5
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
>
> The fetcher has an identity reducer but uses the configure method from the
> mapper, this means large filters are loaded in the reducer as well eating up
> lots of unnecessary heap space.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
