Hello,
We're trying to crawl a very large site, but we really just want all
the html/image URLs on the site - we don't care to search it. Therefor, what's
the best way to have Nutch crawl the site, but NOT index/store pages locally?
Is it even possible?
Thanks,
Branden Makana
