github-actions[bot] commented on PR #7247: URL: https://github.com/apache/texera/pull/7247#issuecomment-5154360713
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 4 worse · ⚪ 11 noise (<±5%) · 0 without baseline > Compared against main `33cc5d1` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30726413232) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 373 | 0.227 | 25,604/34,994/34,994 us | 🔴 -9.6% / 🔴 +123.0% | | 🔴 | bs=100 sw=10 sl=64 | 775 | 0.473 | 126,272/153,919/153,919 us | 🔴 +6.5% / 🔴 +43.3% | | ⚪ | bs=1000 sw=10 sl=64 | 899 | 0.548 | 1,116,342/1,155,503/1,155,503 us | ⚪ within ±5% / 🔴 +12.8% | <details><summary>Baseline details</summary> Latest main `33cc5d1` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 373 tuples/sec | 411 tuples/sec | 782.98 tuples/sec | -9.2% | -52.4% | | bs=10 sw=10 sl=64 | MB/s | 0.227 MB/s | 0.251 MB/s | 0.478 MB/s | -9.6% | -52.5% | | bs=10 sw=10 sl=64 | p50 | 25,604 us | 24,644 us | 12,467 us | +3.9% | +105.4% | | bs=10 sw=10 sl=64 | p95 | 34,994 us | 34,239 us | 15,695 us | +2.2% | +123.0% | | bs=10 sw=10 sl=64 | p99 | 34,994 us | 34,239 us | 18,950 us | +2.2% | +84.7% | | bs=100 sw=10 sl=64 | throughput | 775 tuples/sec | 804 tuples/sec | 996.92 tuples/sec | -3.6% | -22.3% | | bs=100 sw=10 sl=64 | MB/s | 0.473 MB/s | 0.491 MB/s | 0.608 MB/s | -3.7% | -22.3% | | bs=100 sw=10 sl=64 | p50 | 126,272 us | 122,648 us | 100,899 us | +3.0% | +25.1% | | bs=100 sw=10 sl=64 | p95 | 153,919 us | 144,547 us | 107,385 us | +6.5% | +43.3% | | bs=100 sw=10 sl=64 | p99 | 153,919 us | 144,547 us | 115,226 us | +6.5% | +33.6% | | bs=1000 sw=10 sl=64 | throughput | 899 tuples/sec | 919 tuples/sec | 1,024 tuples/sec | -2.2% | -12.2% | | bs=1000 sw=10 sl=64 | MB/s | 0.548 MB/s | 0.561 MB/s | 0.625 MB/s | -2.3% | -12.3% | | bs=1000 sw=10 sl=64 | p50 | 1,116,342 us | 1,086,762 us | 989,300 us | +2.7% | +12.8% | | bs=1000 sw=10 sl=64 | p95 | 1,155,503 us | 1,157,895 us | 1,031,689 us | -0.2% | +12.0% | | bs=1000 sw=10 sl=64 | p99 | 1,155,503 us | 1,157,895 us | 1,058,394 us | -0.2% | +9.2% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,536.86,200,128000,373,0.227,25604.39,34994.24,34994.24 1,100,10,64,20,2581.58,2000,1280000,775,0.473,126272.43,153918.83,153918.83 2,1000,10,64,20,22257.94,20000,12800000,899,0.548,1116341.82,1155503.25,1155503.25 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
