github-actions[bot] commented on PR #9040: URL: https://github.com/apache/texera/pull/9040#issuecomment-6390965270
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 7 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `98c6337` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/40143176878) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 526 | 0.321 | 18,053/28,515/28,515 us | 🔴 +12.6% / 🔴 +100.3% | | 🟢 | bs=100 sw=10 sl=64 | 1,233 | 0.752 | 80,266/90,358/90,358 us | 🟢 -40.9% / 🟢 -12.1% | | 🔴 | bs=1000 sw=10 sl=64 | 1,443 | 0.88 | 691,544/763,007/763,007 us | 🔴 +6.7% / 🟢 +22.1% | <details><summary>Baseline details</summary> Latest main `98c6337` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 526 tuples/sec | 592 tuples/sec | 879.16 tuples/sec | -11.1% | -40.2% | | bs=10 sw=10 sl=64 | MB/s | 0.321 MB/s | 0.361 MB/s | 0.537 MB/s | -11.1% | -40.2% | | bs=10 sw=10 sl=64 | p50 | 18,053 us | 16,032 us | 11,504 us | +12.6% | +56.9% | | bs=10 sw=10 sl=64 | p95 | 28,515 us | 26,442 us | 14,234 us | +7.8% | +100.3% | | bs=10 sw=10 sl=64 | p99 | 28,515 us | 26,442 us | 17,338 us | +7.8% | +64.5% | | bs=100 sw=10 sl=64 | throughput | 1,233 tuples/sec | 1,219 tuples/sec | 1,147 tuples/sec | +1.1% | +7.5% | | bs=100 sw=10 sl=64 | MB/s | 0.752 MB/s | 0.744 MB/s | 0.7 MB/s | +1.1% | +7.4% | | bs=100 sw=10 sl=64 | p50 | 80,266 us | 77,479 us | 88,987 us | +3.6% | -9.8% | | bs=100 sw=10 sl=64 | p95 | 90,358 us | 152,989 us | 96,473 us | -40.9% | -6.3% | | bs=100 sw=10 sl=64 | p99 | 90,358 us | 152,989 us | 102,791 us | -40.9% | -12.1% | | bs=1000 sw=10 sl=64 | throughput | 1,443 tuples/sec | 1,489 tuples/sec | 1,182 tuples/sec | -3.1% | +22.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.88 MB/s | 0.909 MB/s | 0.721 MB/s | -3.2% | +22.0% | | bs=1000 sw=10 sl=64 | p50 | 691,544 us | 673,998 us | 872,751 us | +2.6% | -20.8% | | bs=1000 sw=10 sl=64 | p95 | 763,007 us | 714,851 us | 910,151 us | +6.7% | -16.2% | | bs=1000 sw=10 sl=64 | p99 | 763,007 us | 714,851 us | 941,479 us | +6.7% | -19.0% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,380.06,200,128000,526,0.321,18053.36,28514.66,28514.66 1,100,10,64,20,1622.43,2000,1280000,1233,0.752,80265.87,90357.90,90357.90 2,1000,10,64,20,13863.99,20000,12800000,1443,0.880,691544.10,763007.41,763007.41 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
