github-actions[bot] commented on PR #7863: URL: https://github.com/apache/texera/pull/7863#issuecomment-5383788541
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 5 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `ce0510d` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32612556658) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 404 | 0.247 | 24,157/30,343/30,343 us | 🔴 -13.5% / 🔴 +111.0% | | 🔴 | bs=100 sw=10 sl=64 | 949 | 0.579 | 103,889/148,808/148,808 us | 🔴 +19.8% / 🔴 +49.5% | | ⚪ | bs=1000 sw=10 sl=64 | 1,098 | 0.67 | 909,875/1,051,187/1,051,187 us | ⚪ within ±5% / 🔴 +10.4% | <details><summary>Baseline details</summary> Latest main `ce0510d` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 404 tuples/sec | 467 tuples/sec | 833.79 tuples/sec | -13.5% | -51.5% | | bs=10 sw=10 sl=64 | MB/s | 0.247 MB/s | 0.285 MB/s | 0.509 MB/s | -13.3% | -51.5% | | bs=10 sw=10 sl=64 | p50 | 24,157 us | 22,506 us | 11,864 us | +7.3% | +103.6% | | bs=10 sw=10 sl=64 | p95 | 30,343 us | 31,104 us | 14,381 us | -2.4% | +111.0% | | bs=10 sw=10 sl=64 | p99 | 30,343 us | 31,104 us | 18,035 us | -2.4% | +68.2% | | bs=100 sw=10 sl=64 | throughput | 949 tuples/sec | 925 tuples/sec | 1,083 tuples/sec | +2.6% | -12.4% | | bs=100 sw=10 sl=64 | MB/s | 0.579 MB/s | 0.565 MB/s | 0.661 MB/s | +2.5% | -12.4% | | bs=100 sw=10 sl=64 | p50 | 103,889 us | 108,198 us | 93,077 us | -4.0% | +11.6% | | bs=100 sw=10 sl=64 | p95 | 148,808 us | 124,225 us | 99,553 us | +19.8% | +49.5% | | bs=100 sw=10 sl=64 | p99 | 148,808 us | 124,225 us | 108,604 us | +19.8% | +37.0% | | bs=1000 sw=10 sl=64 | throughput | 1,098 tuples/sec | 1,097 tuples/sec | 1,119 tuples/sec | +0.1% | -1.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.67 MB/s | 0.67 MB/s | 0.683 MB/s | 0.0% | -1.9% | | bs=1000 sw=10 sl=64 | p50 | 909,875 us | 904,166 us | 909,247 us | +0.6% | +0.1% | | bs=1000 sw=10 sl=64 | p95 | 1,051,187 us | 1,002,386 us | 952,561 us | +4.9% | +10.4% | | bs=1000 sw=10 sl=64 | p99 | 1,051,187 us | 1,002,386 us | 985,186 us | +4.9% | +6.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,494.69,200,128000,404,0.247,24157.28,30342.51,30342.51 1,100,10,64,20,2107.34,2000,1280000,949,0.579,103888.70,148808.23,148808.23 2,1000,10,64,20,18211.02,20000,12800000,1098,0.670,909874.72,1051187.38,1051187.38 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
