Hi, Weiwei What about the configuration of Hadoop? Maybe there're 10 processes with 1 thread each.
Thanks! Xiao On 11/27/10, Weiwei Xiong <[email protected]> wrote: > Hi All, > > I'am trying to use nutch to crawl some websites but got a full CPU usage > after it got to depth 2 or 3. I couldn't do anything with the machine but > have to stop the crawling. This happened even when I configured to use only > ONE fetcher thread. > One weird thing I noticed is that the number of threads keeps growing after > running sometime. > > Does anyone have any hint to solve this problem? > > Thanks. > -- ww >
