AJ Chen wrote:
Andrzej, Thanks.
A related question: Some of the sites I crawl use https: or redirect to
https:. Nutch default setting does not recognize https: as valid url.
Is there a way to crawl url starting with "https:"?
Which version of Nutch? 0.7 recognizes and supports https urls, through
the protocol-httpclient plugin.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com