listen i'm experiencing a slow fetching on nutch-0.5.
I saw a long thread on this as in:
http://www.mail-archive.com/[email protected]/msg00976.html
But i don't get the conclusions. I'm running with 10 threads on a bi-processor 2Ghz 1Gb cpu intel
and get: 041225 125343 status: 32500 pages, 9406 errors, 141801369 bytes, 11205119 ms 041225 125343 status: 2.90046 pages/s, 98.8676 kb/s, 4363.119 bytes/page
which is not that good,
i set the truncation on http at 5120 and allows webdb to expand internal links
--
1 December 2004 marks 49 years since Mrs Rosa Parks was arrested inMontgomery, Alabama, for refusing to
give up her seat on a bus to a white man– an arrest that gave birth to the civil rights movement in the US.
------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://productguide.itmanagersjournal.com/ _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
