github-actions[bot] commented on PR #8710: URL: https://github.com/apache/texera/pull/8710#issuecomment-5852383116
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 9 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `ba2667a` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/36291946846) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 346 | 0.211 | 27,374/39,939/39,939 us | 🔴 +8.6% / 🔴 +134.3% | | 🔴 | bs=100 sw=10 sl=64 | 750 | 0.458 | 127,376/184,085/184,085 us | 🔴 +14.2% / 🔴 +59.9% | | ⚪ | bs=1000 sw=10 sl=64 | 889 | 0.542 | 1,111,322/1,278,038/1,278,038 us | ⚪ within ±5% / 🔴 +15.4% | <details><summary>Baseline details</summary> Latest main `ba2667a` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 346 tuples/sec | 372 tuples/sec | 721.84 tuples/sec | -7.0% | -52.1% | | bs=10 sw=10 sl=64 | MB/s | 0.211 MB/s | 0.227 MB/s | 0.441 MB/s | -7.0% | -52.1% | | bs=10 sw=10 sl=64 | p50 | 27,374 us | 26,750 us | 13,416 us | +2.3% | +104.0% | | bs=10 sw=10 sl=64 | p95 | 39,939 us | 36,774 us | 17,046 us | +8.6% | +134.3% | | bs=10 sw=10 sl=64 | p99 | 39,939 us | 36,774 us | 20,349 us | +8.6% | +96.3% | | bs=100 sw=10 sl=64 | throughput | 750 tuples/sec | 807 tuples/sec | 914.39 tuples/sec | -7.1% | -18.0% | | bs=100 sw=10 sl=64 | MB/s | 0.458 MB/s | 0.493 MB/s | 0.558 MB/s | -7.1% | -17.9% | | bs=100 sw=10 sl=64 | p50 | 127,376 us | 121,115 us | 108,507 us | +5.2% | +17.4% | | bs=100 sw=10 sl=64 | p95 | 184,085 us | 161,224 us | 115,131 us | +14.2% | +59.9% | | bs=100 sw=10 sl=64 | p99 | 184,085 us | 161,224 us | 127,181 us | +14.2% | +44.7% | | bs=1000 sw=10 sl=64 | throughput | 889 tuples/sec | 893 tuples/sec | 937.6 tuples/sec | -0.4% | -5.2% | | bs=1000 sw=10 sl=64 | MB/s | 0.542 MB/s | 0.545 MB/s | 0.572 MB/s | -0.6% | -5.3% | | bs=1000 sw=10 sl=64 | p50 | 1,111,322 us | 1,113,787 us | 1,065,461 us | -0.2% | +4.3% | | bs=1000 sw=10 sl=64 | p95 | 1,278,038 us | 1,244,549 us | 1,107,736 us | +2.7% | +15.4% | | bs=1000 sw=10 sl=64 | p99 | 1,278,038 us | 1,244,549 us | 1,133,556 us | +2.7% | +12.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,578.04,200,128000,346,0.211,27374.06,39939.07,39939.07 1,100,10,64,20,2665.19,2000,1280000,750,0.458,127376.44,184084.93,184084.93 2,1000,10,64,20,22509.65,20000,12800000,889,0.542,1111322.01,1278037.77,1278037.77 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
