[
https://issues.apache.org/jira/browse/NUTCH-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165449#comment-17165449
]
ASF GitHub Bot commented on NUTCH-2785:
---------------------------------------
dhkdn9192 commented on pull request #519:
URL: https://github.com/apache/nutch/pull/519#issuecomment-664127212
Hello, thank you for adding the option. However, it seems that the
```job.setNumReduceTasks(numFetchers);``` line is omitted at the end of the
added lines. May I ask you to add?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> FreeGenerator: command-line option to define number of generated fetch lists
> ----------------------------------------------------------------------------
>
> Key: NUTCH-2785
> URL: https://issues.apache.org/jira/browse/NUTCH-2785
> Project: Nutch
> Issue Type: Improvement
> Components: generator
> Affects Versions: 1.16
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.17
>
>
> While Generator allows to specify the number of generated fetch lists using
> the "-numFetchers" command-line option, FreeGenerator does not provide such
> an option. It uses the value of "mapreduce.job.maps" (2 by default), also in
> local mode where Generator always creates only one single fetch list.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)