github-actions[bot] commented on PR #5978: URL: https://github.com/apache/texera/pull/5978#issuecomment-4827116696
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 5 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `1aae005` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28332865042) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 435 | 0.266 | 22,160/34,054/34,054 us | 🔴 +14.2% / 🔴 +122.1% | | 🔴 | bs=100 sw=10 sl=64 | 941 | 0.574 | 103,081/136,855/136,855 us | 🔴 +13.2% / 🔴 +23.8% | | ⚪ | bs=1000 sw=10 sl=64 | 1,098 | 0.67 | 915,315/936,929/936,929 us | ⚪ within ±5% / 🟢 -14.5% | <details><summary>Baseline details</summary> Latest main `1aae005` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 435 tuples/sec | 462 tuples/sec | 757.16 tuples/sec | -5.8% | -42.5% | | bs=10 sw=10 sl=64 | MB/s | 0.266 MB/s | 0.282 MB/s | 0.462 MB/s | -5.7% | -42.4% | | bs=10 sw=10 sl=64 | p50 | 22,160 us | 19,403 us | 12,971 us | +14.2% | +70.8% | | bs=10 sw=10 sl=64 | p95 | 34,054 us | 34,394 us | 15,333 us | -1.0% | +122.1% | | bs=10 sw=10 sl=64 | p99 | 34,054 us | 34,394 us | 18,732 us | -1.0% | +81.8% | | bs=100 sw=10 sl=64 | throughput | 941 tuples/sec | 966 tuples/sec | 957.66 tuples/sec | -2.6% | -1.7% | | bs=100 sw=10 sl=64 | MB/s | 0.574 MB/s | 0.59 MB/s | 0.585 MB/s | -2.7% | -1.8% | | bs=100 sw=10 sl=64 | p50 | 103,081 us | 99,710 us | 103,982 us | +3.4% | -0.9% | | bs=100 sw=10 sl=64 | p95 | 136,855 us | 120,914 us | 110,583 us | +13.2% | +23.8% | | bs=100 sw=10 sl=64 | p99 | 136,855 us | 120,914 us | 118,369 us | +13.2% | +15.6% | | bs=1000 sw=10 sl=64 | throughput | 1,098 tuples/sec | 1,078 tuples/sec | 979.6 tuples/sec | +1.9% | +12.1% | | bs=1000 sw=10 sl=64 | MB/s | 0.67 MB/s | 0.658 MB/s | 0.598 MB/s | +1.8% | +12.1% | | bs=1000 sw=10 sl=64 | p50 | 915,315 us | 930,656 us | 1,024,553 us | -1.6% | -10.7% | | bs=1000 sw=10 sl=64 | p95 | 936,929 us | 948,265 us | 1,063,789 us | -1.2% | -11.9% | | bs=1000 sw=10 sl=64 | p99 | 936,929 us | 948,265 us | 1,096,239 us | -1.2% | -14.5% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,459.66,200,128000,435,0.266,22160.20,34054.37,34054.37 1,100,10,64,20,2125.32,2000,1280000,941,0.574,103081.14,136855.44,136855.44 2,1000,10,64,20,18207.12,20000,12800000,1098,0.670,915315.00,936929.48,936929.48 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
