Thank you for your response Amila. I ended up writing my own custom metrics consumer which writes to a centrailzed data store. That appears to be working well.
On Sat, Aug 30, 2014 at 9:33 AM, Amila Suriarachchi < [email protected]> wrote: > Depending on your requirements you can use different techniques. > > Here[1] is a performance bench mark I found in the net. And here[2] is a > benchmark I attempted to write. > > In my case I tried to measure the throughput and scalability rather than > the latency. For that you can use a counter at the final bolt or at the > spout which prints the thought put after sending specific amount of > messages. For latency you may add a time stamp at the spout and calculate > the time at the final bolt. > > One of the problems I found in my research is that it is difficult to push > messages in a high rate since spout is operating with one thread. > > thanks, > Amila. > > [1] > https://github.com/yahoo/storm-perf-test/blob/master/src/main/java/com/yahoo/storm/perftest/Main.java > [2] https://github.com/amilaSuriarachchi/storm-samples > > On Fri, Aug 29, 2014 at 5:42 PM, Vincent Russell < > [email protected]> wrote: > >> Hello, >> >> Are there any preferred methods for performance testing storm in a real >> cluster. Is there a way to tell when the last bolt in a topology is "done" >> processing tuples in order to tell how long that processing took? >> >> Thanks in advance, >> Vincent >> > > > > -- > Amila Suriarachchi > blog: http://amilachinthaka.blogspot.com/ >
