tustvold commented on PR #3299:
URL: https://github.com/apache/arrow-rs/pull/3299#issuecomment-1343317943
Sort kernels also show just noise
```
sort 2^10 time: [104.00 µs 104.03 µs 104.06 µs]
change: [-1.2425% -1.1335% -0.9317%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
sort 2^12 time: [483.66 µs 483.82 µs 484.01 µs]
change: [-1.5556% -1.4271% -1.2339%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
sort nulls 2^10 time: [94.902 µs 94.929 µs 94.963 µs]
change: [-2.0767% -1.9419% -1.7205%] (p = 0.00 <
0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
sort nulls 2^12 time: [433.50 µs 434.22 µs 435.22 µs]
change: [+5.1418% +6.5300% +8.1729%] (p = 0.00 <
0.05)
Performance has regressed.
bool sort 2^12 time: [227.31 µs 227.36 µs 227.42 µs]
change: [-4.8764% -4.5966% -4.3364%] (p = 0.00 <
0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) low mild
4 (4.00%) high mild
1 (1.00%) high severe
bool sort nulls 2^12 time: [254.96 µs 255.01 µs 255.07 µs]
change: [-1.0141% -0.8698% -0.6497%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
dict string 2^12 time: [37.305 µs 37.338 µs 37.378 µs]
change: [+0.9199% +1.1477% +1.4259%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) high mild
4 (4.00%) high severe
sort 2^12 limit 10 time: [60.756 µs 60.768 µs 60.783 µs]
change: [+1.9449% +2.2653% +2.5586%] (p = 0.00 <
0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
1 (1.00%) high mild
5 (5.00%) high severe
sort 2^12 limit 100 time: [68.230 µs 68.263 µs 68.300 µs]
change: [-1.3582% -1.0502% -0.7583%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe
sort 2^12 limit 1000 time: [185.30 µs 185.34 µs 185.40 µs]
change: [-0.0894% +0.0393% +0.2371%] (p = 0.77 >
0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
sort 2^12 limit 2^12 time: [486.93 µs 487.04 µs 487.17 µs]
change: [-1.1167% -0.9951% -0.8251%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
sort nulls 2^12 limit 10
time: [118.80 µs 118.85 µs 118.90 µs]
change: [-1.1975% -0.9068% -0.6244%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
sort nulls 2^12 limit 100
time: [120.90 µs 120.96 µs 121.01 µs]
change: [-1.2508% -0.9623% -0.6897%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
sort nulls 2^12 limit 1000
time: [137.32 µs 137.37 µs 137.42 µs]
change: [-0.8628% -0.8102% -0.7603%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
sort nulls 2^12 limit 2^12
time: [421.48 µs 421.59 µs 421.71 µs]
change: [-0.4674% -0.2091% +0.0443%] (p = 0.05 >
0.05)
No change in performance detected.
Found 12 outliers among 100 measurements (12.00%)
1 (1.00%) low severe
1 (1.00%) low mild
4 (4.00%) high mild
6 (6.00%) high severe
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
