github-actions[bot] commented on PR #7847: URL: https://github.com/apache/texera/pull/7847#issuecomment-5379987221
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 3 worse · ⚪ 12 noise (<±5%) · 0 without baseline > Compared against main `b7c33b0` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32570311442) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | ⚪ | bs=10 sw=10 sl=64 | 524 | 0.32 | 18,289/27,098/27,098 us | ⚪ within ±5% / 🔴 +80.7% | | 🔴 | bs=100 sw=10 sl=64 | 1,142 | 0.697 | 85,762/117,035/117,035 us | 🔴 +7.8% / 🟢 -13.7% | | ⚪ | bs=1000 sw=10 sl=64 | 1,368 | 0.835 | 726,264/768,493/768,493 us | ⚪ within ±5% / 🟢 +31.1% | <details><summary>Baseline details</summary> Latest main `b7c33b0` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 524 tuples/sec | 550 tuples/sec | 780.31 tuples/sec | -4.7% | -32.8% | | bs=10 sw=10 sl=64 | MB/s | 0.32 MB/s | 0.335 MB/s | 0.476 MB/s | -4.5% | -32.8% | | bs=10 sw=10 sl=64 | p50 | 18,289 us | 17,706 us | 12,590 us | +3.3% | +45.3% | | bs=10 sw=10 sl=64 | p95 | 27,098 us | 28,008 us | 14,995 us | -3.2% | +80.7% | | bs=10 sw=10 sl=64 | p99 | 27,098 us | 28,008 us | 19,141 us | -3.2% | +41.6% | | bs=100 sw=10 sl=64 | throughput | 1,142 tuples/sec | 1,197 tuples/sec | 1,006 tuples/sec | -4.6% | +13.5% | | bs=100 sw=10 sl=64 | MB/s | 0.697 MB/s | 0.73 MB/s | 0.614 MB/s | -4.5% | +13.5% | | bs=100 sw=10 sl=64 | p50 | 85,762 us | 81,413 us | 99,387 us | +5.3% | -13.7% | | bs=100 sw=10 sl=64 | p95 | 117,035 us | 108,596 us | 106,056 us | +7.8% | +10.4% | | bs=100 sw=10 sl=64 | p99 | 117,035 us | 108,596 us | 113,689 us | +7.8% | +2.9% | | bs=1000 sw=10 sl=64 | throughput | 1,368 tuples/sec | 1,380 tuples/sec | 1,043 tuples/sec | -0.9% | +31.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.835 MB/s | 0.842 MB/s | 0.637 MB/s | -0.8% | +31.1% | | bs=1000 sw=10 sl=64 | p50 | 726,264 us | 722,512 us | 965,215 us | +0.5% | -24.8% | | bs=1000 sw=10 sl=64 | p95 | 768,493 us | 795,629 us | 1,009,610 us | -3.4% | -23.9% | | bs=1000 sw=10 sl=64 | p99 | 768,493 us | 795,629 us | 1,039,108 us | -3.4% | -26.0% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,381.50,200,128000,524,0.320,18289.23,27098.31,27098.31 1,100,10,64,20,1752.08,2000,1280000,1142,0.697,85762.49,117035.04,117035.04 2,1000,10,64,20,14623.70,20000,12800000,1368,0.835,726264.28,768493.08,768493.08 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
