Hi Chip, Which version of Nutch are you using? On Tue, Apr 17, 2018 at 7:45 AM, <user-digest-h...@nutch.apache.org> wrote:
> From: Chip Calhoun <ccalh...@aip.org> > To: "user@nutch.apache.org" <user@nutch.apache.org> > Cc: > Bcc: > Date: Tue, 17 Apr 2018 14:45:01 +0000 > Subject: Nutch fetching times out at 3 hours, not sure why. > I crawl a list of roughly 2600 URLs all on my local server, and I'm only > crawling around 1000 of them. The fetcher quits after exactly 3 hours (give > or take a few milliseconds) with this message in the log: > > 2018-04-13 15:50:48,885 INFO fetcher.FetchItemQueues - * queue: > https://history.aip.org >> dropping! > > I've seen that 3 hours is the default in some Nutch installations, but > I've got my fetcher.timelimit.mins set to -1. I'm sure I'm missing > something obvious. Any thoughts would be greatly appreciated. Thank you. > > Chip Calhoun > Digital Archivist > Niels Bohr Library & Archives > American Institute of Physics > One Physics Ellipse > College Park, MD 20740-3840 USA > Tel: +1 301-209-3180 > Email: ccalh...@aip.org > https://www.aip.org/history-programs/niels-bohr-library > > > -- http://home.apache.org/~lewismc/ http://people.apache.org/keys/committer/lewismc
