P. Taylor Goetz created STORM-642:
-------------------------------------

             Summary: Add Storm Benchmarking Framework
                 Key: STORM-642
                 URL: https://issues.apache.org/jira/browse/STORM-642
             Project: Apache Storm
          Issue Type: Improvement
          Components: external
            Reporter: P. Taylor Goetz
            Assignee: P. Taylor Goetz


(This is intended to be a parent for a multi-task JIRA)

Add a framework for benchmarking Storm topologies and clusters that would 
capture basic throughput (messages/sec., MB/sec.) and latency metrics.

Allow for the definition of named "benchmark suites" in a configuration file 
(i.e. YAML) that would define multiple runs of the same benchmark with 
different tuning parameters (# workers, parallelism hints, etc.). This would 
allow for easy comparison of different runs to show how different tuning 
options affect overall performance.

Develop and benchmark both Core Storm and Trident Topologies to illustrate the 
difference in performance characteristics. Benchmark multiple trident 
constructs (joins, aggregations, partition(Persist), etc.) to illustrate 
performance implications.

Document results in a blog post series "Benchmarking Storm" on 
storm.apache.org/blog.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to