Re: fetcher questions

2009-04-17 Thread Dennis Kubes
Alex Basa wrote: Can someone please explain to me fetcher.threads.fetch Number of fetcher threads per map task. So say two task per machine, 10 machines, 10 fetcher threads = 2 x 10 x 10 = 200 fetchers working concurrently in various map tasks. and fetcher.threads.per.host Number

Re: fetcher questions

2009-03-26 Thread Alejandro Gonzalez
i don't know if they're really waiting but i'm almost sure you'll just get 5 threads fetching. if it's a problem for you i think u can turn this restriction off. have an eye on the comments in nutch-default. it includes a pair or restrictions for the same host like max_number_of request or