That is a very good question! I am currently only crawling my local file system, but am about to add an http url, I would love to know the answer.
Have you given it a try yet? -- View this message in context: http://lucene.472066.n3.nabble.com/Nutch-on-file-system-and-web-tp1628971p1642548.html Sent from the Nutch - User mailing list archive at Nabble.com.

