hi,
Lets say I have written a topology like this,
TopologyBuilder builder = new TopologyBuilder();
builder.setSpout("producer", new EventProducer(), 1);
builder.setBolt("receiver", new EventReceiver(),
1).fieldsGrouping("producer", new Fields(Constants.STREAM_ID));
Config conf = new Config();
conf.setNumWorkers(2);
try {
StormSubmitter.submitTopology("ecg", conf,
builder.createTopology());
} catch (AlreadyAliveException e) {
e.printStackTrace();
} catch (InvalidTopologyException e) {
e.printStackTrace();
}
How can I maximize the through put for this case?
Specially how can we do some tcp level optimizations? can we increase the
number tcp connections between spout and the bolt? Can we increase the
number of threads that spout uses in order to push messages more quickly?
I did some tests with default settings and it appear that always the load
average of the cpus kept in around 3.00 (in a 8 core machine) and network
bandwidth usage around 10%. How can I increase those?
thanks,
Amila.
--
Amila Suriarachchi
blog: http://amilachinthaka.blogspot.com/
