tustvold commented on PR #4701:
URL: https://github.com/apache/arrow-rs/pull/4701#issuecomment-1680321039
Latest benchmarks
```
eq Float32 time: [7.6360 µs 7.6405 µs 7.6457 µs]
change: [-17.240% -16.996% -16.750%] (p = 0.00 <
0.05)
Performance has improved.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) high mild
12 (12.00%) high severe
eq scalar Float32 time: [5.2382 µs 5.2407 µs 5.2433 µs]
change: [-2.6651% -2.3977% -2.1336%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
neq Float32 time: [7.3749 µs 7.3801 µs 7.3862 µs]
change: [-27.961% -27.771% -27.616%] (p = 0.00 <
0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
3 (3.00%) high mild
9 (9.00%) high severe
neq scalar Float32 time: [5.2315 µs 5.2346 µs 5.2384 µs]
change: [-35.454% -35.241% -34.988%] (p = 0.00 <
0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
2 (2.00%) high mild
8 (8.00%) high severe
lt Float32 time: [15.455 µs 15.580 µs 15.681 µs]
change: [-5.7116% -4.9659% -4.2590%] (p = 0.00 <
0.05)
Performance has improved.
lt scalar Float32 time: [9.8461 µs 9.8686 µs 9.8992 µs]
change: [+4.0063% +5.2827% +6.7502%] (p = 0.00 <
0.05)
Performance has regressed.
lt_eq Float32 time: [15.896 µs 15.905 µs 15.915 µs]
change: [-10.347% -10.136% -10.003%] (p = 0.00 <
0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
lt_eq scalar Float32 time: [9.7845 µs 9.7888 µs 9.7932 µs]
change: [-21.407% -21.254% -21.051%] (p = 0.00 <
0.05)
Performance has improved.
Found 23 outliers among 100 measurements (23.00%)
11 (11.00%) low mild
5 (5.00%) high mild
7 (7.00%) high severe
gt Float32 time: [15.894 µs 15.905 µs 15.917 µs]
change: [-0.3861% -0.0659% +0.2289%] (p = 0.72 >
0.05)
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
4 (4.00%) high mild
2 (2.00%) high severe
gt scalar Float32 time: [9.7929 µs 9.7982 µs 9.8039 µs]
change: [+0.1360% +0.4044% +0.6769%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
gt_eq Float32 time: [15.868 µs 15.883 µs 15.901 µs]
change: [-9.9332% -9.7737% -9.5779%] (p = 0.00 <
0.05)
Performance has improved.
Found 26 outliers among 100 measurements (26.00%)
12 (12.00%) low mild
4 (4.00%) high mild
10 (10.00%) high severe
gt_eq scalar Float32 time: [9.8059 µs 9.8120 µs 9.8192 µs]
change: [-21.359% -21.226% -21.019%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
eq Int32 time: [7.6663 µs 7.6775 µs 7.6896 µs]
change: [-12.682% -12.410% -12.111%] (p = 0.00 <
0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
eq scalar Int32 time: [5.1598 µs 5.1615 µs 5.1638 µs]
change: [-4.2256% -4.0547% -3.8551%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) high mild
6 (6.00%) high severe
neq Int32 time: [7.5694 µs 7.5728 µs 7.5769 µs]
change: [-20.136% -19.885% -19.648%] (p = 0.00 <
0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
1 (1.00%) high mild
11 (11.00%) high severe
neq scalar Int32 time: [5.1674 µs 5.1699 µs 5.1726 µs]
change: [-36.189% -36.007% -35.816%] (p = 0.00 <
0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) high mild
7 (7.00%) high severe
lt Int32 time: [7.6795 µs 7.6866 µs 7.6961 µs]
change: [-18.855% -17.713% -16.550%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
lt scalar Int32 time: [5.1625 µs 5.1655 µs 5.1691 µs]
change: [-4.2787% -4.0476% -3.8997%] (p = 0.00 <
0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
1 (1.00%) low mild
3 (3.00%) high mild
10 (10.00%) high severe
lt_eq Int32 time: [7.5761 µs 7.5806 µs 7.5861 µs]
change: [-20.731% -20.486% -20.235%] (p = 0.00 <
0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
2 (2.00%) high mild
12 (12.00%) high severe
lt_eq scalar Int32 time: [5.2456 µs 5.2493 µs 5.2536 µs]
change: [-34.425% -34.242% -34.062%] (p = 0.00 <
0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
3 (3.00%) high mild
8 (8.00%) high severe
gt Int32 time: [7.5842 µs 7.5915 µs 7.6007 µs]
change: [-11.722% -10.713% -9.6121%] (p = 0.00 <
0.05)
Performance has improved.
Found 22 outliers among 100 measurements (22.00%)
1 (1.00%) high mild
21 (21.00%) high severe
gt scalar Int32 time: [5.1702 µs 5.1726 µs 5.1753 µs]
change: [-3.9266% -3.6285% -3.3424%] (p = 0.00 <
0.05)
Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
2 (2.00%) low mild
3 (3.00%) high mild
12 (12.00%) high severe
gt_eq Int32 time: [7.6899 µs 7.6971 µs 7.7053 µs]
change: [-21.943% -21.716% -21.463%] (p = 0.00 <
0.05)
Performance has improved.
Found 15 outliers among 100 measurements (15.00%)
4 (4.00%) high mild
11 (11.00%) high severe
gt_eq scalar Int32 time: [5.1667 µs 5.1693 µs 5.1722 µs]
change: [-36.230% -36.051% -35.867%] (p = 0.00 <
0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
2 (2.00%) low mild
3 (3.00%) high mild
9 (9.00%) high severe
eq MonthDayNano time: [63.182 µs 63.378 µs 63.600 µs]
change: [-4.9198% -4.2991% -3.5572%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
eq scalar MonthDayNano time: [54.143 µs 54.196 µs 54.262 µs]
change: [+2.4635% +2.9231% +3.3797%] (p = 0.00 <
0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
eq_dyn_utf8_scalar dictionary[10] string[4])
time: [53.156 µs 53.176 µs 53.197 µs]
change: [-0.0663% +0.1054% +0.3198%] (p = 0.37 >
0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
gt_eq_dyn_utf8_scalar scalar dictionary[10] string[4])
time: [108.95 µs 108.98 µs 109.02 µs]
change: [+1.3318% +1.6177% +1.9018%] (p = 0.00 <
0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
eq dictionary[10] string[4])
time: [388.52 µs 388.82 µs 389.12 µs]
change: [-8.7351% -8.5458% -8.4271%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
