Chris Mattmann wrote:

>Folks,
>
> I've went ahead and added the following comment in nutch-default.xml:
>
>" In order to use HTTPS please enable protocol-httpclient, but be aware of
>possible intermittent problems with the underlying commons-httpclient
>library."
>
> Hopefully this will help folks in the future with this.
>  
>

thanks very much

Michael

>Thanks!
>
>Cheers,
>  Chris
>
>
>
>On 1/24/07 3:29 PM, "Chris Mattmann" <[EMAIL PROTECTED]> wrote:
>
>  
>
>>Hi Guys,
>>
>> Yep, I couldn't remember exactly what the issues were. Thanks for digging
>>that up, Andrzej. So, yeah, anyways it may make sense to update
>>nutch-site.xml with the comment below, with "performance problems" replaced
>>with "intermittent problems with the underlying commons-httpclient library".
>>
>> If you guys agree, I'll add the comment to nutch-site...
>>
>>Cheers,
>>  Chris
>>
>>
>>
>>On 1/24/07 3:10 PM, "Andrzej Bialecki" <[EMAIL PROTECTED]> wrote:
>>
>>    
>>
>>>Michael Wechner wrote:
>>>      
>>>
>>>>ok. So what about adding a comment to nutch-site.xml, e.g.
>>>>
>>>><!-- NOTE: In order to use https please add protocol-httpclient, but
>>>>be aware of possible performance problems! -->
>>>>        
>>>>
>>>They were not performance problems. There were some issues related to
>>>using multiple threads, which would sometimes cause the httpclient
>>>library to fail. There was also a logging message produce in the
>>>internals of httpclient that was difficult to turn off - but now that we
>>>are using log4j this should be straightforward. There was a bug in
>>>chunked encoding handling that would cause hangs.
>>>
>>>There were also other intermittent problems with this library, so after
>>>much deliberation we decided to leave the simpler plugin as the default ...
>>>
>>>These issues may have been solved in a newer version of httpclient library.
>>>      
>>>
>>______________________________________________
>>Chris A. Mattmann
>>[EMAIL PROTECTED]
>>Staff Member
>>Modeling and Data Management Systems Section (387)
>>Data Management Systems and Technologies Group
>>
>>_________________________________________________
>>Jet Propulsion Laboratory            Pasadena, CA
>>Office: 171-266B                        Mailstop:  171-246
>>_______________________________________________________
>>
>>Disclaimer:  The opinions presented within are my own and do not reflect
>>those of either NASA, JPL, or the California Institute of Technology.
>>
>>
>>    
>>
>
>
>
>  
>


-- 
Michael Wechner
Wyona      -   Open Source Content Management   -    Apache Lenya
http://www.wyona.com                      http://lenya.apache.org
[EMAIL PROTECTED]                        [EMAIL PROTECTED]
+41 44 272 91 61


-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general

Reply via email to