Hi Guys, Yep, I couldn't remember exactly what the issues were. Thanks for digging that up, Andrzej. So, yeah, anyways it may make sense to update nutch-site.xml with the comment below, with "performance problems" replaced with "intermittent problems with the underlying commons-httpclient library".
If you guys agree, I'll add the comment to nutch-site... Cheers, Chris On 1/24/07 3:10 PM, "Andrzej Bialecki" <[EMAIL PROTECTED]> wrote: > Michael Wechner wrote: >> ok. So what about adding a comment to nutch-site.xml, e.g. >> >> <!-- NOTE: In order to use https please add protocol-httpclient, but >> be aware of possible performance problems! --> > > They were not performance problems. There were some issues related to > using multiple threads, which would sometimes cause the httpclient > library to fail. There was also a logging message produce in the > internals of httpclient that was difficult to turn off - but now that we > are using log4j this should be straightforward. There was a bug in > chunked encoding handling that would cause hangs. > > There were also other intermittent problems with this library, so after > much deliberation we decided to leave the simpler plugin as the default ... > > These issues may have been solved in a newer version of httpclient library. ______________________________________________ Chris A. Mattmann [EMAIL PROTECTED] Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _________________________________________________ Jet Propulsion Laboratory Pasadena, CA Office: 171-266B Mailstop: 171-246 _______________________________________________________ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology. ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
