github-actions[bot] commented on PR #6822: URL: https://github.com/apache/texera/pull/6822#issuecomment-5055290052
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `0ba5d1a` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29985560625) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 404 | 0.246 | 24,407/30,108/30,108 us | 🔴 +14.0% / 🔴 +91.0% | | 🔴 | bs=100 sw=10 sl=64 | 808 | 0.493 | 123,646/152,476/152,476 us | 🔴 +7.5% / 🔴 +42.0% | | ⚪ | bs=1000 sw=10 sl=64 | 933 | 0.57 | 1,066,640/1,147,317/1,147,317 us | ⚪ within ±5% / 🔴 +11.4% | <details><summary>Baseline details</summary> Latest main `0ba5d1a` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 404 tuples/sec | 448 tuples/sec | 760.2 tuples/sec | -9.8% | -46.9% | | bs=10 sw=10 sl=64 | MB/s | 0.246 MB/s | 0.273 MB/s | 0.464 MB/s | -9.9% | -47.0% | | bs=10 sw=10 sl=64 | p50 | 24,407 us | 21,406 us | 12,781 us | +14.0% | +91.0% | | bs=10 sw=10 sl=64 | p95 | 30,108 us | 31,860 us | 16,118 us | -5.5% | +86.8% | | bs=10 sw=10 sl=64 | p99 | 30,108 us | 31,860 us | 19,074 us | -5.5% | +57.9% | | bs=100 sw=10 sl=64 | throughput | 808 tuples/sec | 832 tuples/sec | 988.68 tuples/sec | -2.9% | -18.3% | | bs=100 sw=10 sl=64 | MB/s | 0.493 MB/s | 0.508 MB/s | 0.603 MB/s | -3.0% | -18.3% | | bs=100 sw=10 sl=64 | p50 | 123,646 us | 119,272 us | 101,448 us | +3.7% | +21.9% | | bs=100 sw=10 sl=64 | p95 | 152,476 us | 141,864 us | 107,410 us | +7.5% | +42.0% | | bs=100 sw=10 sl=64 | p99 | 152,476 us | 141,864 us | 120,258 us | +7.5% | +26.8% | | bs=1000 sw=10 sl=64 | throughput | 933 tuples/sec | 944 tuples/sec | 1,023 tuples/sec | -1.2% | -8.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.57 MB/s | 0.576 MB/s | 0.624 MB/s | -1.0% | -8.7% | | bs=1000 sw=10 sl=64 | p50 | 1,066,640 us | 1,064,518 us | 983,888 us | +0.2% | +8.4% | | bs=1000 sw=10 sl=64 | p95 | 1,147,317 us | 1,126,141 us | 1,030,100 us | +1.9% | +11.4% | | bs=1000 sw=10 sl=64 | p99 | 1,147,317 us | 1,126,141 us | 1,056,513 us | +1.9% | +8.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,495.36,200,128000,404,0.246,24406.93,30107.82,30107.82 1,100,10,64,20,2474.16,2000,1280000,808,0.493,123645.87,152475.66,152475.66 2,1000,10,64,20,21428.15,20000,12800000,933,0.570,1066640.37,1147317.28,1147317.28 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
