OH.. forgot to say.. no I am not parsing while fetching. I had more problems with that so I turned it off.
-- View this message in context: http://lucene.472066.n3.nabble.com/Large-Shared-Drive-Crawl-tp3781917p3783706.html Sent from the Nutch - User mailing list archive at Nabble.com.