Hi Guys, Yep, I couldn't remember exactly what the issues were. Thanks for digging that up, Andrzej. So, yeah, anyways it may make sense to update nutch-site.xml with the comment below, with "performance problems" replaced with "intermittent problems with the underlying commons-httpclient library".
If you guys agree, I'll add the comment to nutch-site... Cheers, Chris On 1/24/07 3:10 PM, "Andrzej Bialecki" <[EMAIL PROTECTED]> wrote: > Michael Wechner wrote: >> ok. So what about adding a comment to nutch-site.xml, e.g. >> >> <!-- NOTE: In order to use https please add protocol-httpclient, but >> be aware of possible performance problems! --> > > They were not performance problems. There were some issues related to > using multiple threads, which would sometimes cause the httpclient > library to fail. There was also a logging message produce in the > internals of httpclient that was difficult to turn off - but now that we > are using log4j this should be straightforward. There was a bug in > chunked encoding handling that would cause hangs. > > There were also other intermittent problems with this library, so after > much deliberation we decided to leave the simpler plugin as the default ... > > These issues may have been solved in a newer version of httpclient library. ______________________________________________ Chris A. Mattmann [EMAIL PROTECTED] Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _________________________________________________ Jet Propulsion Laboratory Pasadena, CA Office: 171-266B Mailstop: 171-246 _______________________________________________________ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology.
