Hi All, I'am trying to use nutch to crawl some websites but got a full CPU usage after it got to depth 2 or 3. I couldn't do anything with the machine but have to stop the crawling. This happened even when I configured to use only ONE fetcher thread. One weird thing I noticed is that the number of threads keeps growing after running sometime.
Does anyone have any hint to solve this problem? Thanks. -- ww
