github-actions[bot] commented on PR #6699: URL: https://github.com/apache/texera/pull/6699#issuecomment-5029892278
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 9 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `0467c76` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29798751624) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 381 | 0.233 | 25,475/33,639/33,639 us | 🔴 -17.4% / 🔴 +115.2% | | 🔴 | bs=100 sw=10 sl=64 | 942 | 0.575 | 105,755/125,540/125,540 us | 🔴 +8.9% / 🔴 +18.4% | | 🔴 | bs=1000 sw=10 sl=64 | 1,093 | 0.667 | 904,121/1,030,623/1,030,623 us | 🔴 +5.9% / 🟢 -7.2% | <details><summary>Baseline details</summary> Latest main `0467c76` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 381 tuples/sec | 461 tuples/sec | 767.23 tuples/sec | -17.4% | -50.3% | | bs=10 sw=10 sl=64 | MB/s | 0.233 MB/s | 0.282 MB/s | 0.468 MB/s | -17.4% | -50.2% | | bs=10 sw=10 sl=64 | p50 | 25,475 us | 21,708 us | 12,705 us | +17.4% | +100.5% | | bs=10 sw=10 sl=64 | p95 | 33,639 us | 31,885 us | 15,633 us | +5.5% | +115.2% | | bs=10 sw=10 sl=64 | p99 | 33,639 us | 31,885 us | 20,214 us | +5.5% | +66.4% | | bs=100 sw=10 sl=64 | throughput | 942 tuples/sec | 967 tuples/sec | 1,001 tuples/sec | -2.6% | -5.9% | | bs=100 sw=10 sl=64 | MB/s | 0.575 MB/s | 0.59 MB/s | 0.611 MB/s | -2.5% | -5.9% | | bs=100 sw=10 sl=64 | p50 | 105,755 us | 104,301 us | 99,949 us | +1.4% | +5.8% | | bs=100 sw=10 sl=64 | p95 | 125,540 us | 115,245 us | 105,996 us | +8.9% | +18.4% | | bs=100 sw=10 sl=64 | p99 | 125,540 us | 115,245 us | 117,999 us | +8.9% | +6.4% | | bs=1000 sw=10 sl=64 | throughput | 1,093 tuples/sec | 1,055 tuples/sec | 1,033 tuples/sec | +3.6% | +5.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.667 MB/s | 0.644 MB/s | 0.631 MB/s | +3.6% | +5.8% | | bs=1000 sw=10 sl=64 | p50 | 904,121 us | 950,901 us | 974,571 us | -4.9% | -7.2% | | bs=1000 sw=10 sl=64 | p95 | 1,030,623 us | 973,223 us | 1,016,467 us | +5.9% | +1.4% | | bs=1000 sw=10 sl=64 | p99 | 1,030,623 us | 973,223 us | 1,048,798 us | +5.9% | -1.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,524.36,200,128000,381,0.233,25475.17,33639.16,33639.16 1,100,10,64,20,2122.58,2000,1280000,942,0.575,105754.99,125539.68,125539.68 2,1000,10,64,20,18298.07,20000,12800000,1093,0.667,904121.24,1030622.51,1030622.51 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
