github-actions[bot] commented on PR #6229: URL: https://github.com/apache/texera/pull/6229#issuecomment-4904399977
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `40526b8` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28869186560) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 408 | 0.249 | 25,315/31,054/31,054 us | 🔴 +16.4% / 🔴 +102.0% | | ⚪ | bs=100 sw=10 sl=64 | 939 | 0.573 | 104,613/135,713/135,713 us | ⚪ within ±5% / 🔴 +27.0% | | 🔴 | bs=1000 sw=10 sl=64 | 1,069 | 0.652 | 933,752/1,068,135/1,068,135 us | 🔴 +14.4% / ⚪ within ±5% | <details><summary>Baseline details</summary> Latest main `40526b8` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 408 tuples/sec | 437 tuples/sec | 776.68 tuples/sec | -6.6% | -47.5% | | bs=10 sw=10 sl=64 | MB/s | 0.249 MB/s | 0.267 MB/s | 0.474 MB/s | -6.7% | -47.5% | | bs=10 sw=10 sl=64 | p50 | 25,315 us | 21,756 us | 12,599 us | +16.4% | +100.9% | | bs=10 sw=10 sl=64 | p95 | 31,054 us | 34,208 us | 15,370 us | -9.2% | +102.0% | | bs=10 sw=10 sl=64 | p99 | 31,054 us | 34,208 us | 18,723 us | -9.2% | +65.9% | | bs=100 sw=10 sl=64 | throughput | 939 tuples/sec | 973 tuples/sec | 994.07 tuples/sec | -3.5% | -5.5% | | bs=100 sw=10 sl=64 | MB/s | 0.573 MB/s | 0.594 MB/s | 0.607 MB/s | -3.5% | -5.6% | | bs=100 sw=10 sl=64 | p50 | 104,613 us | 101,922 us | 100,754 us | +2.6% | +3.8% | | bs=100 sw=10 sl=64 | p95 | 135,713 us | 133,080 us | 106,898 us | +2.0% | +27.0% | | bs=100 sw=10 sl=64 | p99 | 135,713 us | 133,080 us | 113,210 us | +2.0% | +19.9% | | bs=1000 sw=10 sl=64 | throughput | 1,069 tuples/sec | 1,115 tuples/sec | 1,027 tuples/sec | -4.1% | +4.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.652 MB/s | 0.681 MB/s | 0.627 MB/s | -4.3% | +4.0% | | bs=1000 sw=10 sl=64 | p50 | 933,752 us | 898,732 us | 979,814 us | +3.9% | -4.7% | | bs=1000 sw=10 sl=64 | p95 | 1,068,135 us | 933,353 us | 1,019,689 us | +14.4% | +4.8% | | bs=1000 sw=10 sl=64 | p99 | 1,068,135 us | 933,353 us | 1,049,906 us | +14.4% | +1.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,490.58,200,128000,408,0.249,25314.55,31054.35,31054.35 1,100,10,64,20,2129.27,2000,1280000,939,0.573,104613.20,135712.92,135712.92 2,1000,10,64,20,18709.24,20000,12800000,1069,0.652,933752.28,1068135.31,1068135.31 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
