Alex Basa wrote:
Can someone please explain to me
fetcher.threads.fetch
Number of fetcher threads per map task. So say two task per machine, 10
machines, 10 fetcher threads = 2 x 10 x 10 = 200 fetchers working
concurrently in various map tasks.
and
fetcher.threads.per.host
Number
i don't know if they're really waiting but i'm almost sure you'll just get
5 threads fetching. if it's a problem for you i think u can turn this
restriction off. have an eye on the comments in nutch-default. it includes a
pair or restrictions for the same host like max_number_of request or