github-actions[bot] commented on PR #8626:
URL: https://github.com/apache/texera/pull/8626#issuecomment-5757210823

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 4 better · 🔴 0 worse · ⚪ 11 noise (<±5%) · 0 without baseline
   
   > Compared against main `279e12b` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/35573925022)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | 🟢 | bs=10 sw=10 sl=64 | 533 | 0.325 | 19,165/23,963/23,963 us | 🟢 -7.7% / 
🔴 +51.7% |
   | 🟢 | bs=100 sw=10 sl=64 | 1,178 | 0.719 | 84,539/100,977/100,977 us | 🟢 
-5.7% / 🟢 +19.1% |
   | ⚪ | bs=1000 sw=10 sl=64 | 1,402 | 0.856 | 708,761/787,318/787,318 us | ⚪ 
within ±5% / 🟢 +37.2% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `279e12b` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 533 tuples/sec | 521 tuples/sec | 767.43 
tuples/sec | +2.3% | -30.5% |
   | bs=10 sw=10 sl=64 | MB/s | 0.325 MB/s | 0.318 MB/s | 0.468 MB/s | +2.2% | 
-30.6% |
   | bs=10 sw=10 sl=64 | p50 | 19,165 us | 19,653 us | 12,880 us | -2.5% | 
+48.8% |
   | bs=10 sw=10 sl=64 | p95 | 23,963 us | 25,973 us | 15,801 us | -7.7% | 
+51.7% |
   | bs=10 sw=10 sl=64 | p99 | 23,963 us | 25,973 us | 19,767 us | -7.7% | 
+21.2% |
   | bs=100 sw=10 sl=64 | throughput | 1,178 tuples/sec | 1,142 tuples/sec | 
988.73 tuples/sec | +3.2% | +19.1% |
   | bs=100 sw=10 sl=64 | MB/s | 0.719 MB/s | 0.697 MB/s | 0.603 MB/s | +3.2% | 
+19.1% |
   | bs=100 sw=10 sl=64 | p50 | 84,539 us | 88,107 us | 102,684 us | -4.0% | 
-17.7% |
   | bs=100 sw=10 sl=64 | p95 | 100,977 us | 107,045 us | 108,712 us | -5.7% | 
-7.1% |
   | bs=100 sw=10 sl=64 | p99 | 100,977 us | 107,045 us | 118,731 us | -5.7% | 
-15.0% |
   | bs=1000 sw=10 sl=64 | throughput | 1,402 tuples/sec | 1,417 tuples/sec | 
1,022 tuples/sec | -1.1% | +37.1% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.856 MB/s | 0.865 MB/s | 0.624 MB/s | -1.0% 
| +37.2% |
   | bs=1000 sw=10 sl=64 | p50 | 708,761 us | 702,863 us | 999,086 us | +0.8% | 
-29.1% |
   | bs=1000 sw=10 sl=64 | p95 | 787,318 us | 767,557 us | 1,037,033 us | +2.6% 
| -24.1% |
   | bs=1000 sw=10 sl=64 | p99 | 787,318 us | 767,557 us | 1,066,123 us | +2.6% 
| -26.2% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,375.24,200,128000,533,0.325,19164.72,23963.02,23963.02
   1,100,10,64,20,1698.08,2000,1280000,1178,0.719,84539.44,100977.14,100977.14
   
2,1000,10,64,20,14265.34,20000,12800000,1402,0.856,708761.09,787317.69,787317.69
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to