github-actions[bot] commented on PR #8713: URL: https://github.com/apache/texera/pull/8713#issuecomment-5853365243
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `e0f4989` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/36299774293) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 368 | 0.224 | 27,797/35,231/35,231 us | 🔴 +9.6% / 🔴 +107.2% | | 🔴 | bs=100 sw=10 sl=64 | 780 | 0.476 | 123,787/183,055/183,055 us | 🔴 +22.3% / 🔴 +59.0% | | 🔴 | bs=1000 sw=10 sl=64 | 909 | 0.555 | 1,092,547/1,226,214/1,226,214 us | 🔴 +9.1% / 🔴 +10.7% | <details><summary>Baseline details</summary> Latest main `e0f4989` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 368 tuples/sec | 389 tuples/sec | 721.84 tuples/sec | -5.4% | -49.0% | | bs=10 sw=10 sl=64 | MB/s | 0.224 MB/s | 0.237 MB/s | 0.441 MB/s | -5.5% | -49.2% | | bs=10 sw=10 sl=64 | p50 | 27,797 us | 25,370 us | 13,416 us | +9.6% | +107.2% | | bs=10 sw=10 sl=64 | p95 | 35,231 us | 36,954 us | 17,046 us | -4.7% | +106.7% | | bs=10 sw=10 sl=64 | p99 | 35,231 us | 36,954 us | 20,349 us | -4.7% | +73.1% | | bs=100 sw=10 sl=64 | throughput | 780 tuples/sec | 811 tuples/sec | 914.39 tuples/sec | -3.8% | -14.7% | | bs=100 sw=10 sl=64 | MB/s | 0.476 MB/s | 0.495 MB/s | 0.558 MB/s | -3.8% | -14.7% | | bs=100 sw=10 sl=64 | p50 | 123,787 us | 120,522 us | 108,507 us | +2.7% | +14.1% | | bs=100 sw=10 sl=64 | p95 | 183,055 us | 149,634 us | 115,131 us | +22.3% | +59.0% | | bs=100 sw=10 sl=64 | p99 | 183,055 us | 149,634 us | 127,181 us | +22.3% | +43.9% | | bs=1000 sw=10 sl=64 | throughput | 909 tuples/sec | 922 tuples/sec | 937.6 tuples/sec | -1.4% | -3.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.555 MB/s | 0.562 MB/s | 0.572 MB/s | -1.2% | -3.0% | | bs=1000 sw=10 sl=64 | p50 | 1,092,547 us | 1,085,858 us | 1,065,461 us | +0.6% | +2.5% | | bs=1000 sw=10 sl=64 | p95 | 1,226,214 us | 1,124,112 us | 1,107,736 us | +9.1% | +10.7% | | bs=1000 sw=10 sl=64 | p99 | 1,226,214 us | 1,124,112 us | 1,133,556 us | +9.1% | +8.2% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,544.06,200,128000,368,0.224,27797.37,35230.50,35230.50 1,100,10,64,20,2564.43,2000,1280000,780,0.476,123787.41,183055.20,183055.20 2,1000,10,64,20,21993.74,20000,12800000,909,0.555,1092546.78,1226214.45,1226214.45 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
