tungtose commented on PR #2921:
URL: https://github.com/apache/iggy/pull/2921#issuecomment-4098351902
@hubcio Here is a benchmark update using the command line below. I believe
the slow performance come from the frozen code. Regarding that section
(converting from AVec back to Byte), the current implementation is temporary.
It will be improved in an upcoming PR that integrates DirectIOFile and a proper
implementation of the frozen function
`sudo sh -c 'echo 3 > /proc/sys/vm/drop_caches'`
`target/release/iggy-bench --rate-limit 500MB --warmup-time 3s
--total-data 10GB pinned-producer-and-consumer --producers 4 --consumers 4
tcp`
### master:
bench_report::prints: \x1b[32mProducers Results: Total throughput: 249.96
MB/s, 249964 messages/s, average throughput per Producer: 62.49 MB/s, p50
latency: 1.02 ms, p90 latency: 1.81 ms, p95 latency: 2.02 ms, p99 latency: 2.68
ms, p999 latency: 8.90 ms, p9999 latency: 11.91 ms, average latency: 1.17 ms,
median latency: 1.02 ms, min: 0.46 ms, max: 13.07 ms, std dev: 0.13 ms, total
time: 39.98 s\x1b[0m 2026-03-20T12:14:11.068760Z INFO bench_report::prints:
\x1b[32mConsumers Results: Total throughput: 249.97 MB/s, 249971 messages/s,
average throughput per Consumer: 62.49 MB/s, p50 latency: 1.47 ms, p90 latency:
2.31 ms, p95 latency: 2.58 ms, p99 latency: 3.34 ms, p999 latency: 10.22 ms,
p9999 latency: 13.16 ms, average latency: 1.62 ms, median latency: 1.47 ms,
min: 0.67 ms, max: 14.89 ms, std dev: 0.43 ms, total time: 40.08 s\x1b[0m
### PR:
x1b[32mProducers Results: Total throughput: 249.97 MB/s, 249968 messages/s,
average throughput per Producer: 62.49 MB/s, p50 latency: 0.90 ms, p90 latency:
1.39 ms, p95 latency: 1.74 ms, p99 latency: 2.39 ms, p999 latency: 9.49 ms,
p9999 latency: 16.87 ms, average latency: 1.02 ms, median latency: 0.90 ms,
min: 0.43 ms, max: 11.01 ms, std dev: 0.13 ms, total time: 39.98 s\x1b[0m
2026-03-20T13:15:34.355418Z INFO bench_report::prints: \x1b[32mConsumers
Results: Total throughput: 249.92 MB/s, 249916 messages/s, average throughput
per Consumer: 62.48 MB/s, p50 latency: 1.27 ms, p90 latency: 1.97 ms, p95
latency: 2.34 ms, p99 latency: 3.16 ms, p999 latency: 10.42 ms, p9999 latency:
17.44 ms, average latency: 1.42 ms, median latency: 1.27 ms, min: 0.65 ms, max:
20.51 ms, std dev: 0.30 ms, total time: 40.04 s\x1b[0m
2026-03-20T13:15:34.355422Z INFO bench_report::prints: \x1b[31mAggregate
Results: Total throughput: 499.89 MB/s, 499885 messages/s, average throughput
per Actor: 62.49 MB/
s, p50 latency: 1.08 ms, p90 latency: 1.68 ms, p95 latency: 2.04 ms, p99
latency: 2.77 ms, p999 latency: 9.95 ms, p9999 latency: 17.16 ms, average
latency: 1.22 ms, median latency: 1.08 ms, min: 0.43 ms, max: 20.51 ms, std
dev: 0.14 ms, total time: 40.04 s\x1b[0m
### Producers
| Metric | Master | PR | delta |
|----------------|------------|------------|---------|
| p50 latency | 1.02 ms | 0.90 ms | -11.8% |
| p90 latency | 1.81 ms | 1.39 ms | -23.2% |
| p95 latency | 2.02 ms | 1.74 ms | -13.9% |
| p99 latency | 2.68 ms | 2.39 ms | -10.8% |
| p999 latency | 8.90 ms | 9.49 ms | +6.6% |
| p9999 latency | 11.91 ms | 16.87 ms | +41.6% |
| Std dev | 0.13 ms | 0.13 ms | 0% |
### Consumers
| Metric | Master | PR | delta |
|----------------|------------|------------|---------|
| p50 latency | 1.47 ms | 1.27 ms | -13.6% |
| p90 latency | 2.31 ms | 1.97 ms | -14.7% |
| p95 latency | 2.58 ms | 2.34 ms | -9.3% |
| p99 latency | 3.34 ms | 3.16 ms | -5.4% |
| p999 latency | 10.22 ms | 10.42 ms | +2.0% |
| p9999 latency | 13.16 ms | 17.44 ms | +32.5% |
| Std dev | 0.43 ms | 0.30 ms | -30.2% |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
