github-actions[bot] commented on PR #6878:
URL: https://github.com/apache/texera/pull/6878#issuecomment-5076533436

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 5 better · 🔴 0 worse · ⚪ 10 noise (<±5%) · 0 without baseline
   
   > Compared against main `429be11` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/30140979422)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | 🟢 | bs=10 sw=10 sl=64 | 412 | 0.251 | 23,069/31,994/31,994 us | 🟢 -16.8% / 
🔴 +92.8% |
   | 🟢 | bs=100 sw=10 sl=64 | 782 | 0.477 | 126,144/143,281/143,281 us | 🟢 
-12.6% / 🔴 +31.3% |
   | ⚪ | bs=1000 sw=10 sl=64 | 905 | 0.552 | 1,104,910/1,187,043/1,187,043 us | 
⚪ within ±5% / 🔴 +13.4% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `429be11` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 412 tuples/sec | 401 tuples/sec | 754.55 
tuples/sec | +2.7% | -45.4% |
   | bs=10 sw=10 sl=64 | MB/s | 0.251 MB/s | 0.245 MB/s | 0.461 MB/s | +2.4% | 
-45.5% |
   | bs=10 sw=10 sl=64 | p50 | 23,069 us | 24,963 us | 12,816 us | -7.6% | 
+80.0% |
   | bs=10 sw=10 sl=64 | p95 | 31,994 us | 38,445 us | 16,594 us | -16.8% | 
+92.8% |
   | bs=10 sw=10 sl=64 | p99 | 31,994 us | 38,445 us | 19,806 us | -16.8% | 
+61.5% |
   | bs=100 sw=10 sl=64 | throughput | 782 tuples/sec | 792 tuples/sec | 969.38 
tuples/sec | -1.3% | -19.3% |
   | bs=100 sw=10 sl=64 | MB/s | 0.477 MB/s | 0.483 MB/s | 0.592 MB/s | -1.2% | 
-19.4% |
   | bs=100 sw=10 sl=64 | p50 | 126,144 us | 120,850 us | 103,584 us | +4.4% | 
+21.8% |
   | bs=100 sw=10 sl=64 | p95 | 143,281 us | 163,957 us | 109,097 us | -12.6% | 
+31.3% |
   | bs=100 sw=10 sl=64 | p99 | 143,281 us | 163,957 us | 117,304 us | -12.6% | 
+22.1% |
   | bs=1000 sw=10 sl=64 | throughput | 905 tuples/sec | 897 tuples/sec | 1,004 
tuples/sec | +0.9% | -9.8% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.552 MB/s | 0.548 MB/s | 0.613 MB/s | +0.7% 
| -9.9% |
   | bs=1000 sw=10 sl=64 | p50 | 1,104,910 us | 1,117,687 us | 1,002,357 us | 
-1.1% | +10.2% |
   | bs=1000 sw=10 sl=64 | p95 | 1,187,043 us | 1,141,491 us | 1,046,463 us | 
+4.0% | +13.4% |
   | bs=1000 sw=10 sl=64 | p99 | 1,187,043 us | 1,141,491 us | 1,073,661 us | 
+4.0% | +10.6% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,485.67,200,128000,412,0.251,23068.63,31994.36,31994.36
   1,100,10,64,20,2557.18,2000,1280000,782,0.477,126144.10,143281.06,143281.06
   
2,1000,10,64,20,22101.93,20000,12800000,905,0.552,1104910.33,1187042.84,1187042.84
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to