Hi all, Is there any guide or hints on how to configure storm to scale better?
I was running some tests with a custom scheduler and found that the throughput did not scale as expected. Any pointers on what I am doing wrong? Parallelism24816Single Node (Avg)166099161539.5193986N/ATwo Node (Avg)160988 165563174675.5177624.5 The topology is as follows. Spout (Generates events continuously) -> Processing Bolt -> Throughput Measurement Bolt Parallelism is varied for the processing bolt. Parallelism for spout and throughput measuring bolt is kept constant at 20 and 1 respectively. Topology.NUM_WORKERS = 3 Custom scheduler code is available at [1]. Topology code is available at [2]. Any pointers would be much appreciated. Thanks, Lasantha [1] https://github.com/sajithshn/storm-schedulers/blob/master/src/main/java/org/wso2/siddhi/storm/scheduler/RoundRobinStormScheduler.java [2] https://github.com/lasanthafdo/siddhi-storm/blob/master/src/main/java/org/wso2/siddhi/storm/StockDataTopology.java
