github-actions[bot] commented on PR #8012: URL: https://github.com/apache/texera/pull/8012#issuecomment-5432392037
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 6 better · 🔴 1 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `9fe0657` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/33023926537) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 656 | 0.401 | 14,852/17,482/17,482 us | 🟢 -27.5% / 🔴 +33.3% | | 🔴 | bs=100 sw=10 sl=64 | 1,384 | 0.844 | 72,990/79,785/79,785 us | 🟢 -23.8% / 🟢 -21.9% | | 🟢 | bs=1000 sw=10 sl=64 | 1,552 | 0.947 | 641,148/694,608/694,608 us | 🟢 -6.2% / 🟢 +29.5% | <details><summary>Baseline details</summary> Latest main `9fe0657` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 656 tuples/sec | 643 tuples/sec | 894.86 tuples/sec | +2.0% | -26.7% | | bs=10 sw=10 sl=64 | MB/s | 0.401 MB/s | 0.392 MB/s | 0.546 MB/s | +2.3% | -26.6% | | bs=10 sw=10 sl=64 | p50 | 14,852 us | 14,519 us | 11,139 us | +2.3% | +33.3% | | bs=10 sw=10 sl=64 | p95 | 17,482 us | 24,118 us | 13,843 us | -27.5% | +26.3% | | bs=10 sw=10 sl=64 | p99 | 17,482 us | 24,118 us | 16,839 us | -27.5% | +3.8% | | bs=100 sw=10 sl=64 | throughput | 1,384 tuples/sec | 1,376 tuples/sec | 1,166 tuples/sec | +0.6% | +18.7% | | bs=100 sw=10 sl=64 | MB/s | 0.844 MB/s | 0.84 MB/s | 0.711 MB/s | +0.5% | +18.6% | | bs=100 sw=10 sl=64 | p50 | 72,990 us | 69,437 us | 87,509 us | +5.1% | -16.6% | | bs=100 sw=10 sl=64 | p95 | 79,785 us | 104,660 us | 93,675 us | -23.8% | -14.8% | | bs=100 sw=10 sl=64 | p99 | 79,785 us | 104,660 us | 102,153 us | -23.8% | -21.9% | | bs=1000 sw=10 sl=64 | throughput | 1,552 tuples/sec | 1,564 tuples/sec | 1,198 tuples/sec | -0.8% | +29.5% | | bs=1000 sw=10 sl=64 | MB/s | 0.947 MB/s | 0.955 MB/s | 0.731 MB/s | -0.8% | +29.5% | | bs=1000 sw=10 sl=64 | p50 | 641,148 us | 635,283 us | 859,766 us | +0.9% | -25.4% | | bs=1000 sw=10 sl=64 | p95 | 694,608 us | 740,491 us | 902,897 us | -6.2% | -23.1% | | bs=1000 sw=10 sl=64 | p99 | 694,608 us | 740,491 us | 937,957 us | -6.2% | -25.9% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,304.79,200,128000,656,0.401,14851.65,17481.86,17481.86 1,100,10,64,20,1445.54,2000,1280000,1384,0.844,72989.51,79785.31,79785.31 2,1000,10,64,20,12883.49,20000,12800000,1552,0.947,641147.52,694608.26,694608.26 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
