github-actions[bot] commented on PR #8699: URL: https://github.com/apache/texera/pull/8699#issuecomment-5851111002
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 8 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `d102e26` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/36280944839) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 369 | 0.225 | 26,520/31,994/31,994 us | 🔴 -14.2% / 🔴 +97.7% | | 🔴 | bs=100 sw=10 sl=64 | 778 | 0.475 | 125,892/163,984/163,984 us | 🔴 +8.8% / 🔴 +42.4% | | ⚪ | bs=1000 sw=10 sl=64 | 919 | 0.561 | 1,092,507/1,156,156/1,156,156 us | ⚪ within ±5% / ⚪ within ±5% | <details><summary>Baseline details</summary> Latest main `d102e26` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 369 tuples/sec | 430 tuples/sec | 721.84 tuples/sec | -14.2% | -48.9% | | bs=10 sw=10 sl=64 | MB/s | 0.225 MB/s | 0.262 MB/s | 0.441 MB/s | -14.1% | -48.9% | | bs=10 sw=10 sl=64 | p50 | 26,520 us | 23,621 us | 13,416 us | +12.3% | +97.7% | | bs=10 sw=10 sl=64 | p95 | 31,994 us | 30,036 us | 17,046 us | +6.5% | +87.7% | | bs=10 sw=10 sl=64 | p99 | 31,994 us | 30,036 us | 20,349 us | +6.5% | +57.2% | | bs=100 sw=10 sl=64 | throughput | 778 tuples/sec | 828 tuples/sec | 914.39 tuples/sec | -6.0% | -14.9% | | bs=100 sw=10 sl=64 | MB/s | 0.475 MB/s | 0.506 MB/s | 0.558 MB/s | -6.1% | -14.9% | | bs=100 sw=10 sl=64 | p50 | 125,892 us | 115,713 us | 108,507 us | +8.8% | +16.0% | | bs=100 sw=10 sl=64 | p95 | 163,984 us | 163,329 us | 115,131 us | +0.4% | +42.4% | | bs=100 sw=10 sl=64 | p99 | 163,984 us | 163,329 us | 127,181 us | +0.4% | +28.9% | | bs=1000 sw=10 sl=64 | throughput | 919 tuples/sec | 933 tuples/sec | 937.6 tuples/sec | -1.5% | -2.0% | | bs=1000 sw=10 sl=64 | MB/s | 0.561 MB/s | 0.569 MB/s | 0.572 MB/s | -1.4% | -2.0% | | bs=1000 sw=10 sl=64 | p50 | 1,092,507 us | 1,073,306 us | 1,065,461 us | +1.8% | +2.5% | | bs=1000 sw=10 sl=64 | p95 | 1,156,156 us | 1,154,419 us | 1,107,736 us | +0.2% | +4.4% | | bs=1000 sw=10 sl=64 | p99 | 1,156,156 us | 1,154,419 us | 1,133,556 us | +0.2% | +2.0% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,542.24,200,128000,369,0.225,26520.00,31993.93,31993.93 1,100,10,64,20,2569.36,2000,1280000,778,0.475,125891.80,163983.76,163983.76 2,1000,10,64,20,21758.47,20000,12800000,919,0.561,1092506.63,1156156.22,1156156.22 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
