github-actions[bot] commented on PR #8668: URL: https://github.com/apache/texera/pull/8668#issuecomment-5824133643
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 7 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `fbf7733` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/36073663704) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 403 | 0.246 | 23,905/32,933/32,933 us | 🔴 +11.1% / 🔴 +97.3% | | 🔴 | bs=100 sw=10 sl=64 | 827 | 0.505 | 119,830/142,797/142,797 us | 🔴 +10.6% / 🔴 +26.9% | | 🔴 | bs=1000 sw=10 sl=64 | 929 | 0.567 | 1,075,669/1,181,820/1,181,820 us | 🔴 +5.1% / 🔴 +10.3% | <details><summary>Baseline details</summary> Latest main `fbf7733` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 403 tuples/sec | 441 tuples/sec | 735.19 tuples/sec | -8.6% | -45.2% | | bs=10 sw=10 sl=64 | MB/s | 0.246 MB/s | 0.269 MB/s | 0.449 MB/s | -8.6% | -45.2% | | bs=10 sw=10 sl=64 | p50 | 23,905 us | 21,515 us | 13,231 us | +11.1% | +80.7% | | bs=10 sw=10 sl=64 | p95 | 32,933 us | 34,831 us | 16,692 us | -5.4% | +97.3% | | bs=10 sw=10 sl=64 | p99 | 32,933 us | 34,831 us | 19,901 us | -5.4% | +65.5% | | bs=100 sw=10 sl=64 | throughput | 827 tuples/sec | 844 tuples/sec | 943.78 tuples/sec | -2.0% | -12.4% | | bs=100 sw=10 sl=64 | MB/s | 0.505 MB/s | 0.515 MB/s | 0.576 MB/s | -1.9% | -12.3% | | bs=100 sw=10 sl=64 | p50 | 119,830 us | 119,299 us | 105,801 us | +0.4% | +13.3% | | bs=100 sw=10 sl=64 | p95 | 142,797 us | 129,157 us | 112,493 us | +10.6% | +26.9% | | bs=100 sw=10 sl=64 | p99 | 142,797 us | 129,157 us | 126,888 us | +10.6% | +12.5% | | bs=1000 sw=10 sl=64 | throughput | 929 tuples/sec | 937 tuples/sec | 974.98 tuples/sec | -0.9% | -4.7% | | bs=1000 sw=10 sl=64 | MB/s | 0.567 MB/s | 0.572 MB/s | 0.595 MB/s | -0.9% | -4.7% | | bs=1000 sw=10 sl=64 | p50 | 1,075,669 us | 1,070,434 us | 1,030,375 us | +0.5% | +4.4% | | bs=1000 sw=10 sl=64 | p95 | 1,181,820 us | 1,124,410 us | 1,071,362 us | +5.1% | +10.3% | | bs=1000 sw=10 sl=64 | p99 | 1,181,820 us | 1,124,410 us | 1,103,808 us | +5.1% | +7.1% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,495.95,200,128000,403,0.246,23904.91,32932.68,32932.68 1,100,10,64,20,2418.43,2000,1280000,827,0.505,119830.06,142797.15,142797.15 2,1000,10,64,20,21522.03,20000,12800000,929,0.567,1075669.10,1181819.88,1181819.88 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
