Hello,
Copy-paste from nutch0.6 crawl :
>>>>050201 095355 status: 1.8542675 pages/s, 281.1937 kb/s, 19410.79 bytes/page
Isn't the max size download limited to 40 kb for each web page ?
So, with 281kb/s, shouldn't it be about 6 pages/s ? Or is it in kbit rather than in kbyte ?
Why my crawl can it be so slow ?
Thank you very much for this crucial problem.
Christophe N.
------------------------------------------------------- This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting Tool for open source databases. Create drag-&-drop reports. Save time by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc. Download a FREE copy at http://www.intelliview.com/go/osdn_nl _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
