Add a combiner to improve performance on updatedb
-------------------------------------------------
Key: NUTCH-530
URL: https://issues.apache.org/jira/browse/NUTCH-530
Project: Nutch
Issue Type: Improvement
Environment: java 1.6
Reporter: Emmanuel Joke
Assignee: Emmanuel Joke
Fix For: 1.0.0
We have a lot of similar links with status "linked" generated at the ouput of
the map task when we try to update the crawldb based on the segment fetched.
We can use a combiner to improve the performance.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
