alamb commented on PR #7650:
URL: https://github.com/apache/arrow-rs/pull/7650#issuecomment-2977865411

   Here are three runs on main on my gcp VM:
   
   ```
   alamb@aal-dev:~/arrow-rs$ cargo bench --bench coalesce_kernels -- 
'mixed_utf8, 8192, nulls: 0, selectivity: 0.8'
   ..
   filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
                           time:   [8.0962 ms 8.1297 ms 8.1635 ms]
   ...
   filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
                           time:   [7.9674 ms 7.9984 ms 8.0300 ms]
   ...
                           time:   [8.2022 ms 8.2490 ms 8.2975 ms]
                           change: [+2.4166% +3.1325% +3.8706%] (p = 0.00 < 
0.05)
   ...
   ```
   
   Hera are three runs on this branch (basically the same, I can't reproduce 
the different numbers) 🤔 
   ```
        Running benches/coalesce_kernels.rs 
(target/release/deps/coalesce_kernels-57e0af298c8ccbf1)
   filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
                           time:   [8.1231 ms 8.1549 ms 8.1878 ms]
                           change: [−1.8215% −1.1398% −0.4447%] (p = 0.00 < 
0.05)
                           Change within noise threshold.
   Found 1 outliers among 100 measurements (1.00%)
     1 (1.00%) high mild
   
   alamb@aal-dev:~/arrow-rs$ cargo bench --bench coalesce_kernels -- 
'mixed_utf8, 8192, nulls: 0, selectivity: 0.8' && cargo bench --bench 
coalesce_kernels -- 'mixed_utf8, 8192, nulls: 0, selectivity: 0.8'
       Finished `bench` profile [optimized] target(s) in 0.17s
        Running benches/coalesce_kernels.rs 
(target/release/deps/coalesce_kernels-57e0af298c8ccbf1)
   filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
                           time:   [8.2279 ms 8.2742 ms 8.3229 ms]
                           change: [+0.7339% +1.4627% +2.1941%] (p = 0.00 < 
0.05)
                           Change within noise threshold.
   Found 6 outliers among 100 measurements (6.00%)
     5 (5.00%) high mild
     1 (1.00%) high severe
   
       Finished `bench` profile [optimized] target(s) in 0.17s
        Running benches/coalesce_kernels.rs 
(target/release/deps/coalesce_kernels-57e0af298c8ccbf1)
   filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
                           time:   [8.1797 ms 8.2236 ms 8.2693 ms]
                           change: [−1.4209% −0.6114% +0.1819%] (p = 0.13 > 
0.05)
                           No change in performance detected.
   Found 1 outliers among 100 measurements (1.00%)
     1 (1.00%) high mild
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to