I tried the old fetcher a while ago and had the same issue, 2-3 pages per second - While the requestscheduler would do 300+ pages a second (or more)
I'll try and load the latest cvs up on my server. I'm on GigE now so i can really see how well fetcher will fetch! --- Stefan Groschupf <[EMAIL PROTECTED]> wrote: > > Massimo, > > > So, for its performance, and problens solved, I > suggest to restore > > RequestScheduler in the Nuch CVS. > > As far as I had understand Doug, there was several > reasons to delete > the request scheduler. > One of the major points was that there was 2 fetcher > implementation and > that make no sense to maintain 2 implementation in > one project. > The choice to delete the Request-Scheduler was done > from my > understanding since it was the implementation with > no unit tests and a > set of people was reporting problems with it. > Feel free to request feature you miss in the actual > implementation and > or patches are mostly welcome. > > As already mentioned I will track down the fetcher > performance problem > but since this is my spare time just give me a > bit!!! ------------------------------------------------------- This SF.Net email is sponsored by the new InstallShield X. >From Windows to Linux, servers to mobile, InstallShield X is the one installation-authoring solution that does it all. Learn more and evaluate today! http://www.installshield.com/Dev2Dev/0504 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
