hi, I am a student at CSU and currently I am doing a performance comparison among a stream processing system I am developing[1], s4 and storm.
As I have written here[2], we can stress test s4 by using number of threads (eg. 100) at an adapter and sending them through a set of processing elements. My problem is how can I write a similar test with storm? Storm has the same concepts spouts and bolts. In a spout it polls messages using its' own thread. In storm we can set a parameter for parallelism. However as I understood this is the number of spout instances I need to run within in the cluster and always one spout instance invoke with one thread. Is there a way to make one spout invoke from 100 threads? S4 has a concept of cluster which we can use to control where we want to deploy our processing elements and adapters. Is it possible to do a similar thing in storm where I can specify which nodes I want to run spouts and bolts? thanks, Amila. [1] https://github.com/amilaSuriarachchi/stream [2] https://github.com/amilaSuriarachchi/s4-samples/tree/master/src/main/java/edu/colostate/cs/count -- Amila Suriarachchi blog: http://amilachinthaka.blogspot.com/
