github-actions[bot] commented on PR #9041: URL: https://github.com/apache/texera/pull/9041#issuecomment-6390977095
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `98c6337` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/40143178440) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 378 | 0.23 | 26,351/35,663/35,663 us | 🟢 -60.5% / 🔴 +150.6% | | 🔴 | bs=100 sw=10 sl=64 | 835 | 0.51 | 115,024/156,302/156,302 us | 🔴 +15.1% / 🔴 +62.0% | | ⚪ | bs=1000 sw=10 sl=64 | 982 | 0.599 | 1,017,149/1,077,295/1,077,295 us | ⚪ within ±5% / 🔴 +18.4% | <details><summary>Baseline details</summary> Latest main `98c6337` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 378 tuples/sec | 379 tuples/sec | 879.16 tuples/sec | -0.3% | -57.0% | | bs=10 sw=10 sl=64 | MB/s | 0.23 MB/s | 0.231 MB/s | 0.537 MB/s | -0.4% | -57.1% | | bs=10 sw=10 sl=64 | p50 | 26,351 us | 24,156 us | 11,504 us | +9.1% | +129.1% | | bs=10 sw=10 sl=64 | p95 | 35,663 us | 90,374 us | 14,234 us | -60.5% | +150.6% | | bs=10 sw=10 sl=64 | p99 | 35,663 us | 90,374 us | 17,338 us | -60.5% | +105.7% | | bs=100 sw=10 sl=64 | throughput | 835 tuples/sec | 886 tuples/sec | 1,147 tuples/sec | -5.8% | -27.2% | | bs=100 sw=10 sl=64 | MB/s | 0.51 MB/s | 0.54 MB/s | 0.7 MB/s | -5.6% | -27.2% | | bs=100 sw=10 sl=64 | p50 | 115,024 us | 111,137 us | 88,987 us | +3.5% | +29.3% | | bs=100 sw=10 sl=64 | p95 | 156,302 us | 135,787 us | 96,473 us | +15.1% | +62.0% | | bs=100 sw=10 sl=64 | p99 | 156,302 us | 135,787 us | 102,791 us | +15.1% | +52.1% | | bs=1000 sw=10 sl=64 | throughput | 982 tuples/sec | 999 tuples/sec | 1,182 tuples/sec | -1.7% | -16.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.599 MB/s | 0.61 MB/s | 0.721 MB/s | -1.8% | -17.0% | | bs=1000 sw=10 sl=64 | p50 | 1,017,149 us | 999,973 us | 872,751 us | +1.7% | +16.5% | | bs=1000 sw=10 sl=64 | p95 | 1,077,295 us | 1,039,866 us | 910,151 us | +3.6% | +18.4% | | bs=1000 sw=10 sl=64 | p99 | 1,077,295 us | 1,039,866 us | 941,479 us | +3.6% | +14.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,529.67,200,128000,378,0.230,26351.19,35662.75,35662.75 1,100,10,64,20,2393.99,2000,1280000,835,0.510,115023.87,156301.77,156301.77 2,1000,10,64,20,20374.77,20000,12800000,982,0.599,1017148.93,1077294.56,1077294.56 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
