github-actions[bot] commented on PR #6000: URL: https://github.com/apache/texera/pull/6000#issuecomment-4827656813
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 3 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `875ef96` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28338683105) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 408 | 0.249 | 23,291/33,858/33,858 us | 🔴 +8.9% / 🔴 +120.8% | | 🟢 | bs=100 sw=10 sl=64 | 968 | 0.591 | 102,866/119,507/119,507 us | 🟢 -5.0% / 🔴 +8.1% | | ⚪ | bs=1000 sw=10 sl=64 | 1,098 | 0.67 | 915,090/952,369/952,369 us | ⚪ within ±5% / 🟢 -13.1% | <details><summary>Baseline details</summary> Latest main `875ef96` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 408 tuples/sec | 446 tuples/sec | 757.16 tuples/sec | -8.5% | -46.1% | | bs=10 sw=10 sl=64 | MB/s | 0.249 MB/s | 0.272 MB/s | 0.462 MB/s | -8.5% | -46.1% | | bs=10 sw=10 sl=64 | p50 | 23,291 us | 21,384 us | 12,971 us | +8.9% | +79.6% | | bs=10 sw=10 sl=64 | p95 | 33,858 us | 33,006 us | 15,333 us | +2.6% | +120.8% | | bs=10 sw=10 sl=64 | p99 | 33,858 us | 33,006 us | 18,732 us | +2.6% | +80.7% | | bs=100 sw=10 sl=64 | throughput | 968 tuples/sec | 960 tuples/sec | 957.66 tuples/sec | +0.8% | +1.1% | | bs=100 sw=10 sl=64 | MB/s | 0.591 MB/s | 0.586 MB/s | 0.585 MB/s | +0.9% | +1.1% | | bs=100 sw=10 sl=64 | p50 | 102,866 us | 102,088 us | 103,982 us | +0.8% | -1.1% | | bs=100 sw=10 sl=64 | p95 | 119,507 us | 125,850 us | 110,583 us | -5.0% | +8.1% | | bs=100 sw=10 sl=64 | p99 | 119,507 us | 125,850 us | 118,369 us | -5.0% | +1.0% | | bs=1000 sw=10 sl=64 | throughput | 1,098 tuples/sec | 1,088 tuples/sec | 979.6 tuples/sec | +0.9% | +12.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.67 MB/s | 0.664 MB/s | 0.598 MB/s | +0.9% | +12.1% | | bs=1000 sw=10 sl=64 | p50 | 915,090 us | 921,765 us | 1,024,553 us | -0.7% | -10.7% | | bs=1000 sw=10 sl=64 | p95 | 952,369 us | 970,129 us | 1,063,789 us | -1.8% | -10.5% | | bs=1000 sw=10 sl=64 | p99 | 952,369 us | 970,129 us | 1,096,239 us | -1.8% | -13.1% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,490.42,200,128000,408,0.249,23291.11,33858.28,33858.28 1,100,10,64,20,2066.68,2000,1280000,968,0.591,102866.43,119506.61,119506.61 2,1000,10,64,20,18216.72,20000,12800000,1098,0.670,915090.06,952368.61,952368.61 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
