This one caught me too. I wonder if it doesn't make sense to ship new installs with http.content.limit = -1 as the default ?
________________________________________ From: porcelet [[email protected]] Sent: Thursday, August 15, 2013 1:53 PM To: [email protected] Subject: Re: Nutch doen't crawl all links Thank you http.content.limit set at -1 solved my problem. Rock and Metal for life ;) -- View this message in context: http://lucene.472066.n3.nabble.com/Nutch-doen-t-crawl-all-links-tp4084762p4084880.html Sent from the Nutch - User mailing list archive at Nabble.com.
