github-actions[bot] commented on PR #7249: URL: https://github.com/apache/texera/pull/7249#issuecomment-5156218189
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 4 worse · ⚪ 9 noise (<±5%) · 0 without baseline > Compared against main `436b37e` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30737740472) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 407 | 0.248 | 24,102/29,964/29,964 us | 🟢 -10.4% / 🔴 +93.3% | | 🔴 | bs=100 sw=10 sl=64 | 906 | 0.553 | 104,530/164,203/164,203 us | 🔴 +24.3% / 🔴 +52.9% | | 🔴 | bs=1000 sw=10 sl=64 | 1,092 | 0.667 | 910,719/1,126,227/1,126,227 us | 🔴 +19.5% / 🔴 +9.2% | <details><summary>Baseline details</summary> Latest main `436b37e` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 407 tuples/sec | 412 tuples/sec | 782.98 tuples/sec | -1.2% | -48.0% | | bs=10 sw=10 sl=64 | MB/s | 0.248 MB/s | 0.251 MB/s | 0.478 MB/s | -1.2% | -48.1% | | bs=10 sw=10 sl=64 | p50 | 24,102 us | 24,675 us | 12,467 us | -2.3% | +93.3% | | bs=10 sw=10 sl=64 | p95 | 29,964 us | 33,453 us | 15,695 us | -10.4% | +90.9% | | bs=10 sw=10 sl=64 | p99 | 29,964 us | 33,453 us | 18,950 us | -10.4% | +58.1% | | bs=100 sw=10 sl=64 | throughput | 906 tuples/sec | 934 tuples/sec | 996.92 tuples/sec | -3.0% | -9.1% | | bs=100 sw=10 sl=64 | MB/s | 0.553 MB/s | 0.57 MB/s | 0.608 MB/s | -3.0% | -9.1% | | bs=100 sw=10 sl=64 | p50 | 104,530 us | 103,408 us | 100,899 us | +1.1% | +3.6% | | bs=100 sw=10 sl=64 | p95 | 164,203 us | 132,071 us | 107,385 us | +24.3% | +52.9% | | bs=100 sw=10 sl=64 | p99 | 164,203 us | 132,071 us | 115,226 us | +24.3% | +42.5% | | bs=1000 sw=10 sl=64 | throughput | 1,092 tuples/sec | 1,104 tuples/sec | 1,024 tuples/sec | -1.1% | +6.6% | | bs=1000 sw=10 sl=64 | MB/s | 0.667 MB/s | 0.674 MB/s | 0.625 MB/s | -1.0% | +6.7% | | bs=1000 sw=10 sl=64 | p50 | 910,719 us | 913,869 us | 989,300 us | -0.3% | -7.9% | | bs=1000 sw=10 sl=64 | p95 | 1,126,227 us | 942,510 us | 1,031,689 us | +19.5% | +9.2% | | bs=1000 sw=10 sl=64 | p99 | 1,126,227 us | 942,510 us | 1,058,394 us | +19.5% | +6.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,491.90,200,128000,407,0.248,24102.01,29964.19,29964.19 1,100,10,64,20,2206.98,2000,1280000,906,0.553,104529.84,164202.75,164202.75 2,1000,10,64,20,18315.06,20000,12800000,1092,0.667,910718.54,1126226.96,1126226.96 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
