Look at nutch-default.xml (search for "plugin") to see how properties are defined. Copy the one about plugins into nutch-site.xml (same dir). Make sure protocol-httpclient is in the plugin list.
Restart Hadoop if you are already running it. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: Yoav Shapira <[EMAIL PROTECTED]> > To: [email protected] > Sent: Wednesday, May 7, 2008 10:40:22 AM > Subject: Re: How to authenticate with cookies? > > On Wed, May 7, 2008 at 10:24 AM, wrote: > > Heh, I think this is another good use-case for HostDB, which doesn't yet > exist. If this existed, we could store a cookie for each host in >HostDB, > and > include it in CrawlDatum entries used in Fetcher(2). You'd have to dig down > to > o.a.n.protocol.httpclient.Http and add >cookies to the request there, I > believe. > > How do I enable protocol-httpclient and/or make sure it's the one being used? > > Yoav
