github-actions[bot] commented on PR #6800: URL: https://github.com/apache/texera/pull/6800#issuecomment-5051509297
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 1 worse · ⚪ 12 noise (<±5%) · 0 without baseline > Compared against main `bf1f589` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29957125581) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 452 | 0.276 | 20,989/29,391/29,391 us | 🟢 -8.4% / 🔴 +82.3% | | ⚪ | bs=100 sw=10 sl=64 | 944 | 0.576 | 104,582/126,314/126,314 us | ⚪ within ±5% / 🔴 +17.6% | | ⚪ | bs=1000 sw=10 sl=64 | 1,109 | 0.677 | 903,688/944,366/944,366 us | ⚪ within ±5% / 🟢 -10.6% | <details><summary>Baseline details</summary> Latest main `bf1f589` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 452 tuples/sec | 449 tuples/sec | 760.2 tuples/sec | +0.7% | -40.5% | | bs=10 sw=10 sl=64 | MB/s | 0.276 MB/s | 0.274 MB/s | 0.464 MB/s | +0.7% | -40.5% | | bs=10 sw=10 sl=64 | p50 | 20,989 us | 19,385 us | 12,781 us | +8.3% | +64.2% | | bs=10 sw=10 sl=64 | p95 | 29,391 us | 32,088 us | 16,118 us | -8.4% | +82.3% | | bs=10 sw=10 sl=64 | p99 | 29,391 us | 32,088 us | 19,074 us | -8.4% | +54.1% | | bs=100 sw=10 sl=64 | throughput | 944 tuples/sec | 955 tuples/sec | 988.68 tuples/sec | -1.2% | -4.5% | | bs=100 sw=10 sl=64 | MB/s | 0.576 MB/s | 0.583 MB/s | 0.603 MB/s | -1.2% | -4.5% | | bs=100 sw=10 sl=64 | p50 | 104,582 us | 103,848 us | 101,448 us | +0.7% | +3.1% | | bs=100 sw=10 sl=64 | p95 | 126,314 us | 124,075 us | 107,410 us | +1.8% | +17.6% | | bs=100 sw=10 sl=64 | p99 | 126,314 us | 124,075 us | 120,258 us | +1.8% | +5.0% | | bs=1000 sw=10 sl=64 | throughput | 1,109 tuples/sec | 1,121 tuples/sec | 1,023 tuples/sec | -1.1% | +8.4% | | bs=1000 sw=10 sl=64 | MB/s | 0.677 MB/s | 0.684 MB/s | 0.624 MB/s | -1.0% | +8.4% | | bs=1000 sw=10 sl=64 | p50 | 903,688 us | 894,929 us | 983,888 us | +1.0% | -8.2% | | bs=1000 sw=10 sl=64 | p95 | 944,366 us | 933,232 us | 1,030,100 us | +1.2% | -8.3% | | bs=1000 sw=10 sl=64 | p99 | 944,366 us | 933,232 us | 1,056,513 us | +1.2% | -10.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,441.99,200,128000,452,0.276,20989.43,29390.59,29390.59 1,100,10,64,20,2117.54,2000,1280000,944,0.576,104581.66,126314.05,126314.05 2,1000,10,64,20,18036.52,20000,12800000,1109,0.677,903688.14,944366.01,944366.01 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
