github-actions[bot] commented on PR #6667: URL: https://github.com/apache/texera/pull/6667#issuecomment-5029892039
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 3 worse · ⚪ 12 noise (<±5%) · 0 without baseline > Compared against main `0467c76` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29798689568) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | ⚪ | bs=10 sw=10 sl=64 | 375 | 0.229 | 26,376/35,065/35,065 us | ⚪ within ±5% / 🔴 +124.3% | | 🔴 | bs=100 sw=10 sl=64 | 774 | 0.473 | 127,018/171,023/171,023 us | 🔴 -5.0% / 🔴 +61.3% | | 🔴 | bs=1000 sw=10 sl=64 | 895 | 0.546 | 1,119,752/1,209,531/1,209,531 us | 🔴 +5.0% / 🔴 +19.0% | <details><summary>Baseline details</summary> Latest main `0467c76` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 375 tuples/sec | 380 tuples/sec | 767.23 tuples/sec | -1.3% | -51.1% | | bs=10 sw=10 sl=64 | MB/s | 0.229 MB/s | 0.232 MB/s | 0.468 MB/s | -1.3% | -51.1% | | bs=10 sw=10 sl=64 | p50 | 26,376 us | 25,792 us | 12,705 us | +2.3% | +107.6% | | bs=10 sw=10 sl=64 | p95 | 35,065 us | 36,433 us | 15,633 us | -3.8% | +124.3% | | bs=10 sw=10 sl=64 | p99 | 35,065 us | 36,433 us | 20,214 us | -3.8% | +73.5% | | bs=100 sw=10 sl=64 | throughput | 774 tuples/sec | 815 tuples/sec | 1,001 tuples/sec | -5.0% | -22.7% | | bs=100 sw=10 sl=64 | MB/s | 0.473 MB/s | 0.497 MB/s | 0.611 MB/s | -4.8% | -22.6% | | bs=100 sw=10 sl=64 | p50 | 127,018 us | 121,535 us | 99,949 us | +4.5% | +27.1% | | bs=100 sw=10 sl=64 | p95 | 171,023 us | 163,524 us | 105,996 us | +4.6% | +61.3% | | bs=100 sw=10 sl=64 | p99 | 171,023 us | 163,524 us | 117,999 us | +4.6% | +44.9% | | bs=1000 sw=10 sl=64 | throughput | 895 tuples/sec | 912 tuples/sec | 1,033 tuples/sec | -1.9% | -13.4% | | bs=1000 sw=10 sl=64 | MB/s | 0.546 MB/s | 0.556 MB/s | 0.631 MB/s | -1.8% | -13.4% | | bs=1000 sw=10 sl=64 | p50 | 1,119,752 us | 1,096,142 us | 974,571 us | +2.2% | +14.9% | | bs=1000 sw=10 sl=64 | p95 | 1,209,531 us | 1,151,586 us | 1,016,467 us | +5.0% | +19.0% | | bs=1000 sw=10 sl=64 | p99 | 1,209,531 us | 1,151,586 us | 1,048,798 us | +5.0% | +15.3% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,533.88,200,128000,375,0.229,26375.72,35064.97,35064.97 1,100,10,64,20,2583.35,2000,1280000,774,0.473,127018.39,171023.07,171023.07 2,1000,10,64,20,22351.49,20000,12800000,895,0.546,1119751.75,1209530.76,1209530.76 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
