Jimexist commented on pull request #571:
URL: https://github.com/apache/arrow-datafusion/pull/571#issuecomment-865056954
with 1million records and 8k batch size
```
window empty over, aggregate functions
time: [31.516 ms 31.699 ms 31.875 ms]
change: [-2.6548% -1.7125% -0.8447%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
window empty over, built-in functions
time: [24.184 ms 24.441 ms 24.736 ms]
change: [-5.3716% -3.9746% -2.5772%] (p = 0.00 <
0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking window order by, aggregate functions: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 16.9s, or reduce sample count to 20.
window order by, aggregate functions
time: [167.08 ms 168.43 ms 169.84 ms]
change: [-1.6618% -0.5790% +0.4650%] (p = 0.31 >
0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
Benchmarking window order by, built-in functions: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 15.5s, or reduce sample count to 30.
window order by, built-in functions
time: [152.19 ms 153.62 ms 155.08 ms]
change: [-2.6093% -1.1311% +0.2267%] (p = 0.13 >
0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking window partition by, u64_wide, aggregate functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 24.8s, or reduce sample count to 20.
window partition by, u64_wide, aggregate functions
time: [239.96 ms 242.61 ms 245.37 ms]
change: [-5.2335% -3.7045% -2.2581%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking window partition by, u64_narrow, aggregate functions: Warming
up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 13.1s, or reduce sample count to 30.
window partition by, u64_narrow, aggregate functions
time: [125.74 ms 127.00 ms 128.34 ms]
change: [-9.6106% -8.1814% -6.6467%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking window partition by, u64_wide, built-in functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 21.5s, or reduce sample count to 20.
window partition by, u64_wide, built-in functions
time: [207.51 ms 208.79 ms 210.09 ms]
change: [-3.9621% -2.8513% -1.7668%] (p = 0.00 <
0.05)
Performance has improved.
Benchmarking window partition by, u64_narrow, built-in functions: Warming up
for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 11.2s, or reduce sample count to 40.
window partition by, u64_narrow, built-in functions
time: [111.40 ms 112.44 ms 113.55 ms]
change: [-4.1476% -2.8162% -1.5589%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking window partition and order by, u64_wide, aggregate functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 43.5s, or reduce sample count to 10.
window partition and order by, u64_wide, aggregate functions
time: [420.60 ms 423.97 ms 427.48 ms]
change: [-2.0448% -0.9388% +0.1643%] (p = 0.10 >
0.05)
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking window partition and order by, u64_narrow, aggregate functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 62.5s, or reduce sample count to 10.
window partition and order by, u64_narrow, aggregate functions
time: [617.40 ms 623.61 ms 630.15 ms]
change: [+1.3574% +2.6250% +3.9925%] (p = 0.00 <
0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking window partition and order by, u64_wide, built-in functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 38.7s, or reduce sample count to 10.
window partition and order by, u64_wide, built-in functions
time: [382.85 ms 386.08 ms 389.30 ms]
change: [-0.7637% +0.3990% +1.5670%] (p = 0.51 >
0.05)
No change in performance detected.
Benchmarking window partition and order by, u64_narrow, built-in functions:
Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 37.8s, or reduce sample count to 10.
window partition and order by, u64_narrow, built-in functions
time: [374.39 ms 377.18 ms 380.05 ms]
change: [-3.3808% -2.2769% -1.1041%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
