[
https://issues.apache.org/jira/browse/NUTCH-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18102235#comment-18102235
]
ASF GitHub Bot commented on NUTCH-3201:
---------------------------------------
lewismc commented on PR #949:
URL: https://github.com/apache/nutch/pull/949#issuecomment-5198014708
Thanks @sebastian-nagel damn I remember adding this to profile locally and
neglected to clean it up. Fantastic catch. This is just a bad bug. Using
something like [bats](https://github.com/bats-core/bats-core) to unit test
`nutch` and/or `crawl` script wouldn't have caught it either. I kinda wish
MRUnit wasn't sent to the attic as it could have been used to test such cases.
Anyway +1 from me.
> Fetcher launches only a single reduce task, ignoring the configuration
> ----------------------------------------------------------------------
>
> Key: NUTCH-3201
> URL: https://issues.apache.org/jira/browse/NUTCH-3201
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 1.23
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.23
>
>
> Fetcher sets the number of reduce tasks programmatically to 1 -
> [here|https://github.com/apache/nutch/blob/1251a1af5c8ca133fe59d7120e199f94954c0e93/src/java/org/apache/nutch/fetcher/Fetcher.java#L634].
> The configured number of reduce tasks per {{mapreduce.job.reduces}} is
> ignored that way.
> This regression was introduced by NUTCH-3162.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
