github-actions[bot] commented on PR #8048: URL: https://github.com/apache/texera/pull/8048#issuecomment-5439463901
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `b01b11f` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/33068842343) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 375 | 0.229 | 26,359/32,908/32,908 us | 🔴 -13.9% / 🔴 +137.7% | | 🔴 | bs=100 sw=10 sl=64 | 786 | 0.48 | 124,913/152,175/152,175 us | 🔴 +13.8% / 🔴 +62.5% | | ⚪ | bs=1000 sw=10 sl=64 | 934 | 0.57 | 1,072,986/1,128,683/1,128,683 us | ⚪ within ±5% / 🔴 +25.0% | <details><summary>Baseline details</summary> Latest main `b01b11f` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 375 tuples/sec | 435 tuples/sec | 894.86 tuples/sec | -13.8% | -58.1% | | bs=10 sw=10 sl=64 | MB/s | 0.229 MB/s | 0.266 MB/s | 0.546 MB/s | -13.9% | -58.1% | | bs=10 sw=10 sl=64 | p50 | 26,359 us | 23,251 us | 11,139 us | +13.4% | +136.6% | | bs=10 sw=10 sl=64 | p95 | 32,908 us | 30,410 us | 13,843 us | +8.2% | +137.7% | | bs=10 sw=10 sl=64 | p99 | 32,908 us | 30,410 us | 16,839 us | +8.2% | +95.4% | | bs=100 sw=10 sl=64 | throughput | 786 tuples/sec | 823 tuples/sec | 1,166 tuples/sec | -4.5% | -32.6% | | bs=100 sw=10 sl=64 | MB/s | 0.48 MB/s | 0.502 MB/s | 0.711 MB/s | -4.4% | -32.5% | | bs=100 sw=10 sl=64 | p50 | 124,913 us | 122,430 us | 87,509 us | +2.0% | +42.7% | | bs=100 sw=10 sl=64 | p95 | 152,175 us | 133,727 us | 93,675 us | +13.8% | +62.5% | | bs=100 sw=10 sl=64 | p99 | 152,175 us | 133,727 us | 102,153 us | +13.8% | +49.0% | | bs=1000 sw=10 sl=64 | throughput | 934 tuples/sec | 926 tuples/sec | 1,198 tuples/sec | +0.9% | -22.0% | | bs=1000 sw=10 sl=64 | MB/s | 0.57 MB/s | 0.565 MB/s | 0.731 MB/s | +0.9% | -22.1% | | bs=1000 sw=10 sl=64 | p50 | 1,072,986 us | 1,081,819 us | 859,766 us | -0.8% | +24.8% | | bs=1000 sw=10 sl=64 | p95 | 1,128,683 us | 1,182,283 us | 902,897 us | -4.5% | +25.0% | | bs=1000 sw=10 sl=64 | p99 | 1,128,683 us | 1,182,283 us | 937,957 us | -4.5% | +20.3% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,533.40,200,128000,375,0.229,26359.44,32907.69,32907.69 1,100,10,64,20,2544.40,2000,1280000,786,0.480,124912.85,152174.84,152174.84 2,1000,10,64,20,21418.58,20000,12800000,934,0.570,1072985.59,1128683.43,1128683.43 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
