Jimexist commented on pull request #546:
URL: https://github.com/apache/arrow-datafusion/pull/546#issuecomment-867752236
benchmark run:
```
window empty over, aggregate functions
time: [33.347 ms 34.588 ms 35.904 ms]
change: [-3.6454% +0.0126% +3.6391%] (p = 0.98 >
0.05)
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
window empty over, built-in functions
time: [31.568 ms 32.173 ms 32.795 ms]
change: [+18.532% +21.139% +23.772%] (p = 0.00 <
0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking window order by, aggregate functions: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 19.1s, or reduce sample count to 20.
window order by, aggregate functions
time: [204.92 ms 209.64 ms 214.85 ms]
change: [+16.691% +19.909% +22.780%] (p = 0.00 <
0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking window order by, built-in functions: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 18.4s, or reduce sample count to 20.
window order by, built-in functions
time: [176.37 ms 180.63 ms 185.20 ms]
change: [+10.734% +13.444% +16.828%] (p = 0.00 <
0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking window partition by, u64_wide, aggregate functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 21.1s, or reduce sample count to 20.
window partition by, u64_wide, aggregate functions
time: [206.03 ms 208.36 ms 210.84 ms]
change: [-18.160% -16.929% -15.689%] (p = 0.00 <
0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking window partition by, u64_narrow, aggregate functions: Warming
up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 13.1s, or reduce sample count to 30.
window partition by, u64_narrow, aggregate functions
time: [130.24 ms 133.09 ms 136.08 ms]
change: [-5.3256% -3.1363% -0.8213%] (p = 0.01 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking window partition by, u64_wide, built-in functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 17.5s, or reduce sample count to 20.
window partition by, u64_wide, built-in functions
time: [179.48 ms 180.61 ms 181.76 ms]
change: [-18.346% -17.609% -16.863%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking window partition by, u64_narrow, built-in functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 13.4s, or reduce sample count to 30.
window partition by, u64_narrow, built-in functions
time: [118.65 ms 119.75 ms 120.88 ms]
change: [-1.6034% -0.1766% +1.1790%] (p = 0.81 >
0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking window partition and order by, u64_wide, aggregate functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 38.6s, or reduce sample count to 10.
window partition and order by, u64_wide, aggregate functions
time: [379.78 ms 382.19 ms 384.75 ms]
change: [-15.144% -14.176% -13.207%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
Benchmarking window partition and order by, u64_narrow, aggregate functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 54.0s, or reduce sample count to 10.
window partition and order by, u64_narrow, aggregate functions
time: [546.14 ms 555.42 ms 565.09 ms]
change: [-14.362% -12.767% -11.029%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking window partition and order by, u64_wide, built-in functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 39.6s, or reduce sample count to 10.
window partition and order by, u64_wide, built-in functions
time: [392.68 ms 399.86 ms 407.68 ms]
change: [-3.2891% -1.3995% +0.5607%] (p = 0.16 >
0.05)
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking window partition and order by, u64_narrow, built-in functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 40.5s, or reduce sample count to 10.
window partition and order by, u64_narrow, built-in functions
time: [416.35 ms 422.31 ms 428.51 ms]
change: [+0.1759% +1.7816% +3.3761%] (p = 0.04 <
0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
```
i suspect that this requires more sample where multiple window functions are
planned in the same phase.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
