Can someone please explain to me fetcher.threads.fetch
and
fetcher.threads.per.host
Does it mean that if I am only crawling one site and have
fetcher.threads.per.host = 5
fetcher.threads.fetch = 100
that we will only have 5 threads fetching from the one host and the other 95
threads will be waiting?
I couldn't find any documentation on this. Thanks in advance,
Alex
