What is your config? What happens when you run the crawl? What is in your crawldb? What are your seed urls? What is the output of parsechecker on that sight? If you can throw some info our way I'm sure we can help you figure out why you're having problems.
-- Jimmy On Tue, Apr 21, 2015 at 7:19 PM, Shane Wood <[email protected]> wrote: > Is there any reason why Nutch would not crawl this site ? > http://www.bitfixer.com > > I have checked and can not find a robots.txt file. > > Cheers > Shane. >
