This happened to me before for a very specific reason and I'm not sure if it's the same for you. Some of the websites I was trying to access were temporarily down.
I would suggest you check the difference between the logs Remi On Tue, Mar 27, 2012 at 4:28 PM, Elisabeth Adler <[email protected]>wrote: > Hi, > > I'm using Nutch 1.3 to crawl dynamic pages (JSPs) and indexing them into > Solr. With the same settings, I sometimes get more documents indexed, > sometimes less. There are no errors in the log files. The Solr index and > Nutch crawl directory are removed before each crawl, so I have a clean > setup. > What could be the reason for these differences? > > Any pointers appreciated, > Elisabeth >
