Hi guys, I'm sorry if this question has been answered before, I looked but didn't find anything.
This is my scenario (only relevant settings I think): seed urls: about 60 homepages from different domains generate.max.count = 10000 fetcher.threads.per.host = 3 I'm trying to be polite here :-) partition.url.mode = byHost fetcher.threads.fetch = 200 fetcher.threads.per.queue = 1 topN = 1000000 depth = 1 Since the very beggining I've got a lot of spinwaiting threads (I'm not sure if those are threads because it doesn't really say in the log) 194/200 spinwaiting/active, 166 pages, 3 errors, 4.7 3.8 pages/s , 1471 1412 kb/s, 10000 URLs in 19 queues I don't understand why there are 19 queues, is it maybe that only 19 websites are being fetched? Anyways, why is it that there are 194 spinwaiting out of 200 active threads? Thanks a lot in advance for your time. Regards, jc -- View this message in context: http://lucene.472066.n3.nabble.com/a-lot-of-threads-spinwaiting-tp4043801.html Sent from the Nutch - User mailing list archive at Nabble.com.
