AJ Chen wrote:
Andrzej, Thanks.
A related question: Some of the sites I crawl use https: or redirect to https:. Nutch default setting does not recognize https: as valid url. Is there a way to crawl url starting with "https:"?

Which version of Nutch? 0.7 recognizes and supports https urls, through the protocol-httpclient plugin.

--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com

Reply via email to