github-actions[bot] commented on PR #8920: URL: https://github.com/apache/texera/pull/8920#issuecomment-6054496144
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 4 better · 🔴 3 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `40b507d` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/37740832472) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 655 | 0.4 | 14,390/18,891/18,891 us | 🟢 -9.0% / 🔴 +39.2% | | 🔴 | bs=100 sw=10 sl=64 | 1,179 | 0.719 | 85,743/95,169/95,169 us | 🔴 +6.3% / 🟢 -10.3% | | ⚪ | bs=1000 sw=10 sl=64 | 1,505 | 0.919 | 661,583/727,983/727,983 us | ⚪ within ±5% / 🟢 -23.4% | <details><summary>Baseline details</summary> Latest main `40b507d` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 655 tuples/sec | 701 tuples/sec | 960.16 tuples/sec | -6.6% | -31.8% | | bs=10 sw=10 sl=64 | MB/s | 0.4 MB/s | 0.428 MB/s | 0.586 MB/s | -6.5% | -31.7% | | bs=10 sw=10 sl=64 | p50 | 14,390 us | 13,899 us | 11,059 us | +3.5% | +30.1% | | bs=10 sw=10 sl=64 | p95 | 18,891 us | 20,765 us | 13,567 us | -9.0% | +39.2% | | bs=10 sw=10 sl=64 | p99 | 18,891 us | 20,765 us | 16,824 us | -9.0% | +12.3% | | bs=100 sw=10 sl=64 | throughput | 1,179 tuples/sec | 1,198 tuples/sec | 1,235 tuples/sec | -1.6% | -4.5% | | bs=100 sw=10 sl=64 | MB/s | 0.719 MB/s | 0.731 MB/s | 0.754 MB/s | -1.6% | -4.6% | | bs=100 sw=10 sl=64 | p50 | 85,743 us | 80,677 us | 87,809 us | +6.3% | -2.4% | | bs=100 sw=10 sl=64 | p95 | 95,169 us | 100,763 us | 93,907 us | -5.6% | +1.3% | | bs=100 sw=10 sl=64 | p99 | 95,169 us | 100,763 us | 106,076 us | -5.6% | -10.3% | | bs=1000 sw=10 sl=64 | throughput | 1,505 tuples/sec | 1,510 tuples/sec | 1,272 tuples/sec | -0.3% | +18.4% | | bs=1000 sw=10 sl=64 | MB/s | 0.919 MB/s | 0.922 MB/s | 0.776 MB/s | -0.3% | +18.4% | | bs=1000 sw=10 sl=64 | p50 | 661,583 us | 656,112 us | 863,168 us | +0.8% | -23.4% | | bs=1000 sw=10 sl=64 | p95 | 727,983 us | 724,812 us | 907,700 us | +0.4% | -19.8% | | bs=1000 sw=10 sl=64 | p99 | 727,983 us | 724,812 us | 933,684 us | +0.4% | -22.0% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,305.19,200,128000,655,0.400,14390.23,18890.74,18890.74 1,100,10,64,20,1696.67,2000,1280000,1179,0.719,85742.89,95168.83,95168.83 2,1000,10,64,20,13288.34,20000,12800000,1505,0.919,661583.19,727983.11,727983.11 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
