Hi Doug,
Many thanks fro your fast response. I'm waiting a fetch process of 6000000 pages with Old fetcher (Requestscheduler) After the fetcher.done I starting a test with the patched version.
Thanks,
Massimo
Doug Cutting wrote:
Doug Cutting wrote:
I just checked in a modified version of Stefan's patch. With this, I can fetch 4 pages/second with my 1.5Mbit connection using 20 threads. Please tell me how this works for you.
I've now tried this a bit more. If I set fetcher.server.delay to 1 second and use a machine with a faster connection I can now get around 50 pages/second.
Doug
------------------------------------------------------- This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
------------------------------------------------------- This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
