[
https://issues.apache.org/jira/browse/NUTCH-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610218#comment-16610218
]
Sebastian Nagel commented on NUTCH-2637:
----------------------------------------
Hi [~sinsi404], good catch, thanks! This is likely a relic, as Nutch 1.x
fetches in the map phase. {{mapreduce.job.maps}} is also mentioned in the
command-line help and the javadoc (lines 30, 251, 271). Could you also change
these lines? Thanks!
> Number of fetcher reducers is misconfigured when the arg not passed
> -------------------------------------------------------------------
>
> Key: NUTCH-2637
> URL: https://issues.apache.org/jira/browse/NUTCH-2637
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 2.3, 2.3.1
> Reporter: Fumio Nakajima
> Priority: Minor
>
> I'm kind a new to this, so sorry if i'm wrong.
> The thing is the number of fetcher reducers are currently set to the value
> of "mapreduce.job.maps" when the arg not passed. It should be
> "mapreduce.job.reduces".
>
> [https://github.com/apache/nutch/blob/2.x/src/java/org/apache/nutch/fetcher/FetcherJob.java#L216]
> Line: 216, branch-2.X
> {code:java}
> if (numTasks == null || numTasks < 1) {
> currentJob.setNumReduceTasks(currentJob.getConfiguration().getInt(
> "mapreduce.job.maps", currentJob.getNumReduceTasks()));
> } else {
> currentJob.setNumReduceTasks(numTasks);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
