Hello! The spout or bolt are running as instances (tasks) inside in an executor threa. You can run more tasks per executor thread by they will tun sequential. You can read more about the storm parallelism here:
http://storm.incubator.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html Regarding your question about how to specify where to place the spout and bolts on nodes what you need is a scheduler class that will be put in a library that will be added to nimbus lib folder. You can find more information here http://storm.incubator.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html and here https://github.com/xumingming/storm-lib/blob/master/src/jvm/storm/DemoScheduler.java I have done someting similar for my project and it worked. I hope that these help. Regards, Florin On Sun, Aug 17, 2014 at 6:29 PM, Amila Suriarachchi < [email protected]> wrote: > hi, > > I am a student at CSU and currently I am doing a performance comparison > among a stream processing system I am developing[1], s4 and storm. > > As I have written here[2], we can stress test s4 by using number of > threads (eg. 100) at an adapter and sending them through a set of > processing elements. My problem is how can I write a similar test with > storm? > > Storm has the same concepts spouts and bolts. In a spout it polls messages > using its' own thread. In storm we can set a parameter for parallelism. > However as I understood this is the number of spout instances I need to run > within in the cluster and always one spout instance invoke with one thread. > Is there a way to make one spout invoke from 100 threads? > > S4 has a concept of cluster which we can use to control where we want to > deploy our processing elements and adapters. Is it possible to do a similar > thing in storm where I can specify which nodes I want to run spouts and > bolts? > > thanks, > Amila. > > > [1] https://github.com/amilaSuriarachchi/stream > [2] > https://github.com/amilaSuriarachchi/s4-samples/tree/master/src/main/java/edu/colostate/cs/count > > > -- > Amila Suriarachchi > blog: http://amilachinthaka.blogspot.com/ >
