Chris Mattmann wrote:
Folks,
I've went ahead and added the following comment in nutch-default.xml:
" In order to use HTTPS please enable protocol-httpclient, but be aware of
possible intermittent problems with the underlying commons-httpclient
library."
Hopefully this will help folks in the future with this.
thanks very much
Michael
Thanks!
Cheers,
Chris
On 1/24/07 3:29 PM, "Chris Mattmann" <[EMAIL PROTECTED]> wrote:
Hi Guys,
Yep, I couldn't remember exactly what the issues were. Thanks for digging
that up, Andrzej. So, yeah, anyways it may make sense to update
nutch-site.xml with the comment below, with "performance problems" replaced
with "intermittent problems with the underlying commons-httpclient library".
If you guys agree, I'll add the comment to nutch-site...
Cheers,
Chris
On 1/24/07 3:10 PM, "Andrzej Bialecki" <[EMAIL PROTECTED]> wrote:
Michael Wechner wrote:
ok. So what about adding a comment to nutch-site.xml, e.g.
<!-- NOTE: In order to use https please add protocol-httpclient, but
be aware of possible performance problems! -->
They were not performance problems. There were some issues related to
using multiple threads, which would sometimes cause the httpclient
library to fail. There was also a logging message produce in the
internals of httpclient that was difficult to turn off - but now that we
are using log4j this should be straightforward. There was a bug in
chunked encoding handling that would cause hangs.
There were also other intermittent problems with this library, so after
much deliberation we decided to leave the simpler plugin as the default ...
These issues may have been solved in a newer version of httpclient library.
______________________________________________
Chris A. Mattmann
[EMAIL PROTECTED]
Staff Member
Modeling and Data Management Systems Section (387)
Data Management Systems and Technologies Group
_________________________________________________
Jet Propulsion Laboratory Pasadena, CA
Office: 171-266B Mailstop: 171-246
_______________________________________________________
Disclaimer: The opinions presented within are my own and do not reflect
those of either NASA, JPL, or the California Institute of Technology.
--
Michael Wechner
Wyona - Open Source Content Management - Apache Lenya
http://www.wyona.com http://lenya.apache.org
[EMAIL PROTECTED] [EMAIL PROTECTED]
+41 44 272 91 61
