Hi, If it's a form-based authentication where you need to send Http POST requests, then I would suggest you modify HttpResponse.java for the purpose
Remi On Sat, Mar 22, 2014 at 2:31 AM, John Lafitte <[email protected]>wrote: > I haven't done it myself but it's documented here: > http://wiki.apache.org/nutch/HttpAuthenticationSchemes > > I'm not sure how you would do it with forms based auth, but if it's a > custom app you might be able to just automatically grant it access if it > the user agent and/or IP match up. > > > On Fri, Mar 21, 2014 at 12:32 PM, Laura McCord <[email protected]> > wrote: > > > Hi, > > > > I have another question... If I have an authenticated site that I want to > > crawl in which I have access with my username/password. Is there a > > configuration step where I would add my credentials or is this something > > that had to be customized on my end? > > > > Thanks Again, > > Laura > > >
