Sebastian Nagel created NUTCH-3201:
--------------------------------------

             Summary: Fetcher launches only a single reduce task, ignoring the 
configuration
                 Key: NUTCH-3201
                 URL: https://issues.apache.org/jira/browse/NUTCH-3201
             Project: Nutch
          Issue Type: Bug
          Components: fetcher
    Affects Versions: 1.23
            Reporter: Sebastian Nagel
             Fix For: 1.23


Fetcher sets the number of reduce tasks programmatically to 1 - 
[here|https://github.com/apache/nutch/blob/1251a1af5c8ca133fe59d7120e199f94954c0e93/src/java/org/apache/nutch/fetcher/Fetcher.java#L634].

The configured number of reduce tasks per {{mapreduce.job.reduces}} is ignored 
that way.

This regression was introduced by NUTCH-3162.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to