github-actions[bot] commented on PR #6048: URL: https://github.com/apache/texera/pull/6048#issuecomment-4858925003
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 6 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `baca3f9` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28538827035) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 452 | 0.276 | 22,114/28,815/28,815 us | 🔴 +10.9% / 🔴 +94.9% | | 🔴 | bs=100 sw=10 sl=64 | 935 | 0.57 | 104,162/158,675/158,675 us | 🔴 +26.4% / 🔴 +48.4% | | ⚪ | bs=1000 sw=10 sl=64 | 1,105 | 0.675 | 907,912/949,980/949,980 us | ⚪ within ±5% / 🟢 -9.9% | <details><summary>Baseline details</summary> Latest main `baca3f9` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 452 tuples/sec | 466 tuples/sec | 786.27 tuples/sec | -3.0% | -42.5% | | bs=10 sw=10 sl=64 | MB/s | 0.276 MB/s | 0.284 MB/s | 0.48 MB/s | -2.8% | -42.5% | | bs=10 sw=10 sl=64 | p50 | 22,114 us | 19,942 us | 12,495 us | +10.9% | +77.0% | | bs=10 sw=10 sl=64 | p95 | 28,815 us | 30,514 us | 14,784 us | -5.6% | +94.9% | | bs=10 sw=10 sl=64 | p99 | 28,815 us | 30,514 us | 18,468 us | -5.6% | +56.0% | | bs=100 sw=10 sl=64 | throughput | 935 tuples/sec | 994 tuples/sec | 991.49 tuples/sec | -5.9% | -5.7% | | bs=100 sw=10 sl=64 | MB/s | 0.57 MB/s | 0.607 MB/s | 0.605 MB/s | -6.1% | -5.8% | | bs=100 sw=10 sl=64 | p50 | 104,162 us | 97,253 us | 100,929 us | +7.1% | +3.2% | | bs=100 sw=10 sl=64 | p95 | 158,675 us | 125,580 us | 106,894 us | +26.4% | +48.4% | | bs=100 sw=10 sl=64 | p99 | 158,675 us | 125,580 us | 114,085 us | +26.4% | +39.1% | | bs=1000 sw=10 sl=64 | throughput | 1,105 tuples/sec | 1,114 tuples/sec | 1,023 tuples/sec | -0.8% | +8.0% | | bs=1000 sw=10 sl=64 | MB/s | 0.675 MB/s | 0.68 MB/s | 0.624 MB/s | -0.7% | +8.1% | | bs=1000 sw=10 sl=64 | p50 | 907,912 us | 898,247 us | 983,835 us | +1.1% | -7.7% | | bs=1000 sw=10 sl=64 | p95 | 949,980 us | 999,338 us | 1,023,777 us | -4.9% | -7.2% | | bs=1000 sw=10 sl=64 | p99 | 949,980 us | 999,338 us | 1,053,883 us | -4.9% | -9.9% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,442.28,200,128000,452,0.276,22114.42,28814.86,28814.86 1,100,10,64,20,2140.04,2000,1280000,935,0.570,104161.56,158674.63,158674.63 2,1000,10,64,20,18093.38,20000,12800000,1105,0.675,907911.68,949980.25,949980.25 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
