> Ok, this isn't true because it is sorted by using HashComparator. For > some reason > generated list contains some parts wich are more or less sorted by host > and some > parts looks more "random".
This is consistent with what I am seeing; the Fetcher slowing down for a while, sometimes coming to a virtual halt (a lot of repeated fetch speed statements, for instance "412052 pages, 95915 errors, 3.0 pages/s, 638 kb/s,"), then the Fetcher speeding up again and fetching at acceptable fetch speeds. Rgrds, Thomas Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
