On Sep 5, 2010, at 2:56pm, mrbeagle wrote:
I have a server app that currently has 100 worker threads that fetch
data
from links. Currently I have
ConnManagerParams.setMaxTotalConnections(httpParams,
Integer.MAX_VALUE);
but I'm curious what I should be setting that to and I'm not sure I
know
what factors go into deciding that number, ram? network bandwidth?
cpu?
Whats the rule of thumb for determining the optimal number for your
app?
I don't know of any quantitative ways to set that number to an
appropriate value.
For tuning this on some EC2 instances, I kept bumping it up until I
started seeing reduced gain in throughput, coupled with high(er) load
on the box.
External factors such as whether you've got a local caching DNS server
can influence throughput as well (if you're doing a large-scale web
crawl, at least) so this tuning needs to include the entire
environment, not just HttpClient parameters.
-- Ken
--------------------------
Ken Krugler
+1 530-210-6378
http://bixolabs.com
e l a s t i c w e b m i n i n g
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
