github-actions[bot] commented on PR #7996: URL: https://github.com/apache/texera/pull/7996#issuecomment-5429684574
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 4 worse · ⚪ 9 noise (<±5%) · 0 without baseline > Compared against main `444fc58` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32998893586) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 375 | 0.229 | 25,561/33,383/33,383 us | 🟢 -9.0% / 🔴 +141.2% | | 🔴 | bs=100 sw=10 sl=64 | 767 | 0.468 | 125,793/196,040/196,040 us | 🔴 +28.8% / 🔴 +109.3% | | ⚪ | bs=1000 sw=10 sl=64 | 912 | 0.557 | 1,084,833/1,207,128/1,207,128 us | ⚪ within ±5% / 🔴 +33.7% | <details><summary>Baseline details</summary> Latest main `444fc58` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 375 tuples/sec | 373 tuples/sec | 894.86 tuples/sec | +0.5% | -58.1% | | bs=10 sw=10 sl=64 | MB/s | 0.229 MB/s | 0.228 MB/s | 0.546 MB/s | +0.4% | -58.1% | | bs=10 sw=10 sl=64 | p50 | 25,561 us | 24,494 us | 11,139 us | +4.4% | +129.5% | | bs=10 sw=10 sl=64 | p95 | 33,383 us | 36,683 us | 13,843 us | -9.0% | +141.2% | | bs=10 sw=10 sl=64 | p99 | 33,383 us | 36,683 us | 16,839 us | -9.0% | +98.2% | | bs=100 sw=10 sl=64 | throughput | 767 tuples/sec | 815 tuples/sec | 1,166 tuples/sec | -5.9% | -34.2% | | bs=100 sw=10 sl=64 | MB/s | 0.468 MB/s | 0.498 MB/s | 0.711 MB/s | -6.0% | -34.2% | | bs=100 sw=10 sl=64 | p50 | 125,793 us | 121,321 us | 87,509 us | +3.7% | +43.7% | | bs=100 sw=10 sl=64 | p95 | 196,040 us | 152,247 us | 93,675 us | +28.8% | +109.3% | | bs=100 sw=10 sl=64 | p99 | 196,040 us | 152,247 us | 102,153 us | +28.8% | +91.9% | | bs=1000 sw=10 sl=64 | throughput | 912 tuples/sec | 897 tuples/sec | 1,198 tuples/sec | +1.7% | -23.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.557 MB/s | 0.547 MB/s | 0.731 MB/s | +1.8% | -23.8% | | bs=1000 sw=10 sl=64 | p50 | 1,084,833 us | 1,118,932 us | 859,766 us | -3.0% | +26.2% | | bs=1000 sw=10 sl=64 | p95 | 1,207,128 us | 1,198,616 us | 902,897 us | +0.7% | +33.7% | | bs=1000 sw=10 sl=64 | p99 | 1,207,128 us | 1,198,616 us | 937,957 us | +0.7% | +28.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,533.62,200,128000,375,0.229,25560.62,33383.28,33383.28 1,100,10,64,20,2607.38,2000,1280000,767,0.468,125793.43,196040.00,196040.00 2,1000,10,64,20,21921.87,20000,12800000,912,0.557,1084833.39,1207128.03,1207128.03 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
