Hi, I'have tested Nutch from start with all Linux Kernel and with all Jvm from Ibm 1.4.x to Sun Java 1.5 only to solve an try to discover the cause of the problems with RequestScheduler and outofmemory. So at last, the problem was discovered and is the HTTP1.1 protocol. Also in the sun Java forums many users have problems with HTTP1.1. So, setting in nuctch-site.xml HTTP1.1 to false, the RequestScheduler start to work wery weel, no outofmemory, no slodown in fetch process. With 8Mbit connection I haved fetched about 120-130 pages a second at costant rate. After 4 day, and when the fetchilist was empty the RequestScheduler end is process regular and generate fetcher.done file. So, for its performance, and problens solved, I suggest to restore RequestScheduler in the Nuch CVS. Wath think the Nutch developers about?
Massimo P.S. I'm a sys admin, kernel tuning etc. Can I help Nutch? ------------------------------------------------------- This SF.Net email is sponsored by the new InstallShield X. >From Windows to Linux, servers to mobile, InstallShield X is the one installation-authoring solution that does it all. Learn more and evaluate today! http://www.installshield.com/Dev2Dev/0504 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
