github-actions[bot] commented on PR #6377: URL: https://github.com/apache/texera/pull/6377#issuecomment-4953264392
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `afa8af2` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29213914799) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 483 | 0.295 | 19,290/33,947/33,947 us | 🔴 +14.8% / 🔴 +133.0% | | 🟢 | bs=100 sw=10 sl=64 | 1,202 | 0.734 | 83,391/96,146/96,146 us | 🟢 -19.9% / 🟢 -13.5% | | ⚪ | bs=1000 sw=10 sl=64 | 1,443 | 0.88 | 690,012/732,699/732,699 us | ⚪ within ±5% / 🟢 +31.9% | <details><summary>Baseline details</summary> Latest main `afa8af2` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 483 tuples/sec | 528 tuples/sec | 825.74 tuples/sec | -8.5% | -41.5% | | bs=10 sw=10 sl=64 | MB/s | 0.295 MB/s | 0.322 MB/s | 0.504 MB/s | -8.4% | -41.5% | | bs=10 sw=10 sl=64 | p50 | 19,290 us | 16,932 us | 12,003 us | +13.9% | +60.7% | | bs=10 sw=10 sl=64 | p95 | 33,947 us | 29,583 us | 14,566 us | +14.8% | +133.0% | | bs=10 sw=10 sl=64 | p99 | 33,947 us | 29,583 us | 18,190 us | +14.8% | +86.6% | | bs=100 sw=10 sl=64 | throughput | 1,202 tuples/sec | 1,192 tuples/sec | 1,072 tuples/sec | +0.8% | +12.1% | | bs=100 sw=10 sl=64 | MB/s | 0.734 MB/s | 0.727 MB/s | 0.654 MB/s | +1.0% | +12.2% | | bs=100 sw=10 sl=64 | p50 | 83,391 us | 79,921 us | 94,522 us | +4.3% | -11.8% | | bs=100 sw=10 sl=64 | p95 | 96,146 us | 120,106 us | 101,111 us | -19.9% | -4.9% | | bs=100 sw=10 sl=64 | p99 | 96,146 us | 120,106 us | 111,122 us | -19.9% | -13.5% | | bs=1000 sw=10 sl=64 | throughput | 1,443 tuples/sec | 1,405 tuples/sec | 1,094 tuples/sec | +2.7% | +31.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.88 MB/s | 0.858 MB/s | 0.668 MB/s | +2.6% | +31.8% | | bs=1000 sw=10 sl=64 | p50 | 690,012 us | 709,978 us | 934,546 us | -2.8% | -26.2% | | bs=1000 sw=10 sl=64 | p95 | 732,699 us | 760,502 us | 975,104 us | -3.7% | -24.9% | | bs=1000 sw=10 sl=64 | p99 | 732,699 us | 760,502 us | 1,005,414 us | -3.7% | -27.1% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,414.30,200,128000,483,0.295,19290.04,33946.65,33946.65 1,100,10,64,20,1663.72,2000,1280000,1202,0.734,83390.65,96146.39,96146.39 2,1000,10,64,20,13864.47,20000,12800000,1443,0.880,690012.16,732698.88,732698.88 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
