Yicong-Huang commented on PR #5639:
URL: https://github.com/apache/texera/pull/5639#issuecomment-4687937122

   <!-- texera-benchmarks-rich-preview -->
   > Preview generated from fork branch `ci/benchmark-main-comparison` using 
#5639 benchmark artifact and the live `gh-pages` baseline. The automatic bot 
comment will look like this after the workflow change is on `main`.
   
   ## โš ๏ธ Benchmark changes need a look
   
   **Summary:** ๐ŸŸข 3 better ยท ๐Ÿ”ด 9 worse ยท โšช 0 unchanged ยท 0 without baseline
   
   _Compared with latest main `1572edf` from 2026-06-12T05:45:00.344Z published 
to the benchmark dashboard._
   
   [Full dashboard](https://apache.github.io/texera/dev/bench/) ยท [Workflow 
run](https://github.com/apache/texera/actions/runs/27397378517)
   
   | status | metric | PR | main | change |
   |---|---|---:|---:|---:|
   | ๐Ÿ”ด worse | bs=10 sw=10 sl=64 | 401.7 tuples/sec | 416.67 tuples/sec | -3.6% 
|
   | ๐Ÿ”ด worse | bs=100 sw=10 sl=64 | 926.11 tuples/sec | 938.37 tuples/sec | 
-1.3% |
   | ๐Ÿ”ด worse | bs=1000 sw=10 sl=64 | 1,071 tuples/sec | 1,095 tuples/sec | 
-2.2% |
   | ๐ŸŸข better | p50 / bs=10 sw=10 sl=64 | 23,842 us | 25,005 us | -4.7% |
   | ๐Ÿ”ด worse | p95 / bs=10 sw=10 sl=64 | 35,316 us | 32,182 us | +9.7% |
   | ๐Ÿ”ด worse | p99 / bs=10 sw=10 sl=64 | 35,316 us | 32,182 us | +9.7% |
   | ๐Ÿ”ด worse | p50 / bs=100 sw=10 sl=64 | 108,608 us | 108,068 us | +0.5% |
   | ๐Ÿ”ด worse | p95 / bs=100 sw=10 sl=64 | 127,075 us | 116,218 us | +9.3% |
   | ๐Ÿ”ด worse | p99 / bs=100 sw=10 sl=64 | 127,075 us | 116,218 us | +9.3% |
   | ๐Ÿ”ด worse | p50 / bs=1000 sw=10 sl=64 | 938,509 us | 903,009 us | +3.9% |
   | ๐ŸŸข better | p95 / bs=1000 sw=10 sl=64 | 982,807 us | 990,044 us | -0.7% |
   | ๐ŸŸข better | p99 / bs=1000 sw=10 sl=64 | 982,807 us | 990,044 us | -0.7% |
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,497.88,200,128000,402,0.245,23842.09,35315.91,35315.91
   1,100,10,64,20,2159.57,2000,1280000,926,0.565,108607.53,127074.57,127074.57
   
2,1000,10,64,20,18682.28,20000,12800000,1071,0.653,938508.84,982807.28,982807.28
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to