github-actions[bot] commented on PR #6088:
URL: https://github.com/apache/texera/pull/6088#issuecomment-4880892836

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 0 better · 🔴 0 worse · ⚪ 15 noise (<±5%) · 0 without baseline
   
   > Compared against main `5786a10` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/28696926272)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | ⚪ | bs=10 sw=10 sl=64 | 400 | 0.244 | 24,540/34,359/34,359 us | ⚪ within 
±5% / 🔴 +124.1% |
   | ⚪ | bs=100 sw=10 sl=64 | 794 | 0.484 | 122,581/144,635/144,635 us | ⚪ 
within ±5% / 🔴 +33.5% |
   | ⚪ | bs=1000 sw=10 sl=64 | 917 | 0.56 | 1,086,326/1,132,661/1,132,661 us | 
⚪ within ±5% / 🔴 +9.7% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `5786a10` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 400 tuples/sec | 415 tuples/sec | 772.08 
tuples/sec | -3.6% | -48.2% |
   | bs=10 sw=10 sl=64 | MB/s | 0.244 MB/s | 0.253 MB/s | 0.471 MB/s | -3.6% | 
-48.2% |
   | bs=10 sw=10 sl=64 | p50 | 24,540 us | 23,685 us | 12,745 us | +3.6% | 
+92.5% |
   | bs=10 sw=10 sl=64 | p95 | 34,359 us | 33,989 us | 15,330 us | +1.1% | 
+124.1% |
   | bs=10 sw=10 sl=64 | p99 | 34,359 us | 33,989 us | 19,054 us | +1.1% | 
+80.3% |
   | bs=100 sw=10 sl=64 | throughput | 794 tuples/sec | 806 tuples/sec | 982.64 
tuples/sec | -1.5% | -19.2% |
   | bs=100 sw=10 sl=64 | MB/s | 0.484 MB/s | 0.492 MB/s | 0.6 MB/s | -1.6% | 
-19.3% |
   | bs=100 sw=10 sl=64 | p50 | 122,581 us | 121,710 us | 101,961 us | +0.7% | 
+20.2% |
   | bs=100 sw=10 sl=64 | p95 | 144,635 us | 148,157 us | 108,335 us | -2.4% | 
+33.5% |
   | bs=100 sw=10 sl=64 | p99 | 144,635 us | 148,157 us | 114,379 us | -2.4% | 
+26.5% |
   | bs=1000 sw=10 sl=64 | throughput | 917 tuples/sec | 919 tuples/sec | 1,013 
tuples/sec | -0.2% | -9.5% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.56 MB/s | 0.561 MB/s | 0.618 MB/s | -0.2% | 
-9.4% |
   | bs=1000 sw=10 sl=64 | p50 | 1,086,326 us | 1,083,091 us | 993,573 us | 
+0.3% | +9.3% |
   | bs=1000 sw=10 sl=64 | p95 | 1,132,661 us | 1,130,355 us | 1,032,489 us | 
+0.2% | +9.7% |
   | bs=1000 sw=10 sl=64 | p99 | 1,132,661 us | 1,130,355 us | 1,065,526 us | 
+0.2% | +6.3% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,499.67,200,128000,400,0.244,24539.87,34358.63,34358.63
   1,100,10,64,20,2519.79,2000,1280000,794,0.484,122580.71,144634.64,144634.64
   
2,1000,10,64,20,21806.19,20000,12800000,917,0.560,1086325.99,1132660.68,1132660.68
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to