github-actions[bot] commented on PR #7823: URL: https://github.com/apache/texera/pull/7823#issuecomment-5376739418
<!-- texera-benchmarks-comment --> ## ✅ No material benchmark regressions detected 🟢 4 better · 🔴 0 worse · ⚪ 11 noise (<±5%) · 0 without baseline > Compared against main `2edbdf9` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32539752194) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 402 | 0.246 | 24,567/29,781/29,781 us | 🟢 -16.2% / 🔴 +98.6% | | 🟢 | bs=100 sw=10 sl=64 | 812 | 0.496 | 122,786/143,113/143,113 us | 🟢 -20.0% / 🔴 +34.9% | | ⚪ | bs=1000 sw=10 sl=64 | 928 | 0.567 | 1,079,662/1,137,546/1,137,546 us | ⚪ within ±5% / 🔴 +12.7% | <details><summary>Baseline details</summary> Latest main `2edbdf9` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 402 tuples/sec | 407 tuples/sec | 780.31 tuples/sec | -1.2% | -48.5% | | bs=10 sw=10 sl=64 | MB/s | 0.246 MB/s | 0.249 MB/s | 0.476 MB/s | -1.2% | -48.3% | | bs=10 sw=10 sl=64 | p50 | 24,567 us | 23,591 us | 12,590 us | +4.1% | +95.1% | | bs=10 sw=10 sl=64 | p95 | 29,781 us | 35,549 us | 14,995 us | -16.2% | +98.6% | | bs=10 sw=10 sl=64 | p99 | 29,781 us | 35,549 us | 19,141 us | -16.2% | +55.6% | | bs=100 sw=10 sl=64 | throughput | 812 tuples/sec | 813 tuples/sec | 1,006 tuples/sec | -0.1% | -19.3% | | bs=100 sw=10 sl=64 | MB/s | 0.496 MB/s | 0.496 MB/s | 0.614 MB/s | 0.0% | -19.2% | | bs=100 sw=10 sl=64 | p50 | 122,786 us | 118,173 us | 99,387 us | +3.9% | +23.5% | | bs=100 sw=10 sl=64 | p95 | 143,113 us | 178,858 us | 106,056 us | -20.0% | +34.9% | | bs=100 sw=10 sl=64 | p99 | 143,113 us | 178,858 us | 113,689 us | -20.0% | +25.9% | | bs=1000 sw=10 sl=64 | throughput | 928 tuples/sec | 926 tuples/sec | 1,043 tuples/sec | +0.2% | -11.0% | | bs=1000 sw=10 sl=64 | MB/s | 0.567 MB/s | 0.565 MB/s | 0.637 MB/s | +0.4% | -10.9% | | bs=1000 sw=10 sl=64 | p50 | 1,079,662 us | 1,077,761 us | 965,215 us | +0.2% | +11.9% | | bs=1000 sw=10 sl=64 | p95 | 1,137,546 us | 1,148,055 us | 1,009,610 us | -0.9% | +12.7% | | bs=1000 sw=10 sl=64 | p99 | 1,137,546 us | 1,148,055 us | 1,039,108 us | -0.9% | +9.5% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,496.96,200,128000,402,0.246,24566.69,29781.43,29781.43 1,100,10,64,20,2462.30,2000,1280000,812,0.496,122785.79,143112.99,143112.99 2,1000,10,64,20,21543.44,20000,12800000,928,0.567,1079662.22,1137545.72,1137545.72 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
