Hi All, I would like to know the relationship between the two config properties *fetcher.threads.fetch* and *fetcher.threads.per.host*.
1. If lets say I am crawling 10 hosts in my seed file and set the fetcher.threads.per.host property to 3 , should I set the fetcher.threads.fetch property to 10*3 i.e >=30 ? 2. I can understand the *fetcher.threads.per.host *property as it is self explanatory , which means number to concurrent connections to a particular host , however , I am not able to clearly follow what *fetcher.threads.fetch *does. 3. Also I would like to know how the *fetcher.threads.per.host* property comes into play in a distributed mode ? Thanks in advance.
