GGraziadei opened a new pull request, #8706:
URL: https://github.com/apache/storm/pull/8706

   ## What is the purpose of the change
   
   This PR introduces a repeatable, Docker-based distributed Storm dev cluster 
designed for realistic benchmarking `storm-perf` on a local machine. It 
provisions a complete environment, including Nimbus, ZooKeeper, and two 
Supervisor, forcing inter-worker traffic across the network to trigger true 
serialization overhead.
   Backed by a full observability stack (Prometheus and Grafana), the setup 
provides granular, per-task tracking via Storm Metrics v2. Additionally, it 
includes a `netsim.sh` utility to inject controlled network latency and jitter, 
allowing developers to easily stress-test topology resilience and analyze 
bottlenecks under degraded network conditions.
   
   ## How was the change tested
   
   I verified the environment by executing the benchmark smoke test outlined in 
the README.md, running the `FileReadWordCountTopo` topology for 120 seconds 
across two workers on separate supervisors. 
   Smoke testing successfully validated the baseline performance and the 
replication of bottlenecks. Injecting typical datacenter network conditions (3 
ms latency, 1 ms jitter) caused average complete latency to rise from 390 ms to 
446 ms; this induced back-pressure safely reduced total tuple throughput from 
40.93M to 36.25M without dropping packets.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to