I haven't done it myself but it's documented here: http://wiki.apache.org/nutch/HttpAuthenticationSchemes
I'm not sure how you would do it with forms based auth, but if it's a custom app you might be able to just automatically grant it access if it the user agent and/or IP match up. On Fri, Mar 21, 2014 at 12:32 PM, Laura McCord <[email protected]> wrote: > Hi, > > I have another question... If I have an authenticated site that I want to > crawl in which I have access with my username/password. Is there a > configuration step where I would add my credentials or is this something > that had to be customized on my end? > > Thanks Again, > Laura >
