github-actions[bot] commented on PR #8621: URL: https://github.com/apache/texera/pull/8621#issuecomment-5756785057
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 3 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `5036097` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/35570873270) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 363 | 0.222 | 25,903/35,881/35,881 us | 🔴 +9.9% / 🔴 +127.1% | | 🟢 | bs=100 sw=10 sl=64 | 800 | 0.488 | 124,941/141,801/141,801 us | 🟢 -6.4% / 🔴 +30.4% | | ⚪ | bs=1000 sw=10 sl=64 | 913 | 0.557 | 1,088,132/1,193,053/1,193,053 us | ⚪ within ±5% / 🔴 +15.0% | <details><summary>Baseline details</summary> Latest main `5036097` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 363 tuples/sec | 391 tuples/sec | 767.43 tuples/sec | -7.2% | -52.7% | | bs=10 sw=10 sl=64 | MB/s | 0.222 MB/s | 0.238 MB/s | 0.468 MB/s | -6.7% | -52.6% | | bs=10 sw=10 sl=64 | p50 | 25,903 us | 23,566 us | 12,880 us | +9.9% | +101.1% | | bs=10 sw=10 sl=64 | p95 | 35,881 us | 36,553 us | 15,801 us | -1.8% | +127.1% | | bs=10 sw=10 sl=64 | p99 | 35,881 us | 36,553 us | 19,767 us | -1.8% | +81.5% | | bs=100 sw=10 sl=64 | throughput | 800 tuples/sec | 817 tuples/sec | 988.73 tuples/sec | -2.1% | -19.1% | | bs=100 sw=10 sl=64 | MB/s | 0.488 MB/s | 0.499 MB/s | 0.603 MB/s | -2.2% | -19.1% | | bs=100 sw=10 sl=64 | p50 | 124,941 us | 121,423 us | 102,684 us | +2.9% | +21.7% | | bs=100 sw=10 sl=64 | p95 | 141,801 us | 151,454 us | 108,712 us | -6.4% | +30.4% | | bs=100 sw=10 sl=64 | p99 | 141,801 us | 151,454 us | 118,731 us | -6.4% | +19.4% | | bs=1000 sw=10 sl=64 | throughput | 913 tuples/sec | 922 tuples/sec | 1,022 tuples/sec | -1.0% | -10.7% | | bs=1000 sw=10 sl=64 | MB/s | 0.557 MB/s | 0.563 MB/s | 0.624 MB/s | -1.1% | -10.7% | | bs=1000 sw=10 sl=64 | p50 | 1,088,132 us | 1,087,929 us | 999,086 us | +0.0% | +8.9% | | bs=1000 sw=10 sl=64 | p95 | 1,193,053 us | 1,137,583 us | 1,037,033 us | +4.9% | +15.0% | | bs=1000 sw=10 sl=64 | p99 | 1,193,053 us | 1,137,583 us | 1,066,123 us | +4.9% | +11.9% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,550.58,200,128000,363,0.222,25902.83,35880.75,35880.75 1,100,10,64,20,2499.20,2000,1280000,800,0.488,124941.47,141801.45,141801.45 2,1000,10,64,20,21907.96,20000,12800000,913,0.557,1088132.17,1193052.57,1193052.57 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
