[jira] Commented: (NUTCH-776) Configurable queue depth

2010-01-07 Thread Julien Nioche (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12797653#action_12797653 ] Julien Nioche commented on NUTCH-776: - Did you notice any improvement in the fetch rate

Re: [jira] Commented: (NUTCH-776) Configurable queue depth

2010-01-07 Thread MilleBii
Actually I created a key to set it adequately... The best results came with a depth of 1 and a big number of threads (I use 1800) ?!? That is because I have numerous sites (like blogs) that have different domain names and single IP... This a result of topical focused crawling. Since it was not