viirya commented on PR #5398:
URL: https://github.com/apache/arrow-rs/pull/5398#issuecomment-1944421038
The benchmark is mixed with improvement and a little regression:
```
4096 u64_small(0) - 128 time: [70.724 µs 70.777 µs 70.867 µs]
change: [-12.211% -12.012% -11.792%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
4096 u64_small(0) - 1024
time: [55.353 µs 55.382 µs 55.417 µs]
change: [-12.536% -12.217% -11.812%] (p = 0.00 <
0.05)
Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
1 (1.00%) low mild
3 (3.00%) high mild
9 (9.00%) high severe
4096 u64_small(0) - 4096
time: [54.867 µs 55.030 µs 55.169 µs]
change: [-11.483% -11.257% -10.999%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
4096 i64(0) - 128 time: [114.86 µs 114.93 µs 115.04 µs]
change: [-23.963% -23.561% -23.122%] (p = 0.00 <
0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) high mild
7 (7.00%) high severe
4096 i64(0) - 1024 time: [99.625 µs 100.80 µs 101.90 µs]
change: [-27.344% -26.984% -26.517%] (p = 0.00 <
0.05)
Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
3 (3.00%) high mild
14 (14.00%) high severe
4096 i64(0) - 4096 time: [108.51 µs 108.94 µs 109.50 µs]
change: [-18.432% -17.622% -16.805%] (p = 0.00 <
0.05)
Performance has improved.
```
```
4096 u64(0) - 1024 time: [115.03 µs 115.18 µs 115.41 µs]
change: [+4.2654% +4.4768% +4.6911%] (p = 0.00 <
0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
4096 u64(0) - 4096 time: [121.25 µs 121.51 µs 121.87 µs]
change: [+5.9620% +6.6001% +7.2883%] (p = 0.00 <
0.05)
Performance has regressed.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
