[
https://issues.apache.org/jira/browse/NUTCH-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13971471#comment-13971471
]
Julien Nioche commented on NUTCH-1147:
--------------------------------------
Good idea not to force it to 1 but what about relying on the standard
'mapred.reduce.tasks' param which can either be set globally or specified on
the command line (see crawl script) instead of implementing a special param for
it?
> WebGraph nodeDumper uses only 1 reducer
> ---------------------------------------
>
> Key: NUTCH-1147
> URL: https://issues.apache.org/jira/browse/NUTCH-1147
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Trivial
> Fix For: 1.9
>
> Attachments: NUTCH-1147-1.5-1.patch
>
>
> The noderDumper is restricted to only one reducer, making it slow and
> producing too large files.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
