comphead commented on PR #9824:
URL:
https://github.com/apache/arrow-datafusion/pull/9824#issuecomment-2024153821
With `Arc<String>`
```
logical_select_one_from_700
time: [590.03 µs 591.75 µs 593.50 µs]
change: [-3.8311% -3.3439% -2.8110%] (p = 0.00 <
0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) low mild
4 (4.00%) high mild
1 (1.00%) high severe
physical_select_one_from_700
time: [2.5903 ms 2.5966 ms 2.6029 ms]
change: [+0.9541% +1.3643% +1.7661%] (p = 0.00 <
0.05)
Change within noise threshold.
Benchmarking logical_select_all_from_1000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 6.9s, or reduce sample count to 70.
logical_select_all_from_1000
time: [68.628 ms 68.932 ms 69.243 ms]
change: [+0.7792% +1.3932% +2.0657%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low mild
2 (2.00%) high mild
Benchmarking physical_select_all_from_1000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 51.2s, or reduce sample count to 10.
physical_select_all_from_1000
time: [509.48 ms 510.84 ms 512.22 ms]
change: [+3.2665% +3.6282% +4.0088%] (p = 0.00 <
0.05)
Performance has regressed.
logical_trivial_join_low_numbered_columns
time: [608.20 µs 610.94 µs 613.41 µs]
change: [-4.3832% -3.7492% -3.0800%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) low mild
1 (1.00%) high mild
1 (1.00%) high severe
logical_trivial_join_high_numbered_columns
time: [646.02 µs 648.13 µs 650.31 µs]
change: [-3.2821% -2.7965% -2.3021%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
2 (2.00%) low mild
1 (1.00%) high mild
1 (1.00%) high severe
logical_aggregate_with_join
time: [849.03 µs 851.57 µs 854.03 µs]
change: [-5.5567% -5.1253% -4.6791%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
3 (3.00%) low mild
1 (1.00%) high mild
physical_plan_tpch_q1 time: [3.7277 ms 3.7385 ms 3.7494 ms]
change: [-2.7537% -2.3180% -1.8824%] (p = 0.00 <
0.05)
Performance has improved.
physical_plan_tpch_q2 time: [5.7276 ms 5.7456 ms 5.7636 ms]
change: [-8.3477% -7.9163% -7.4741%] (p = 0.00 <
0.05)
Performance has improved.
Benchmarking physical_plan_tpch_q3: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 10.0s, enable flat sampling, or reduce sample count to 40.
physical_plan_tpch_q3 time: [1.9718 ms 1.9769 ms 1.9820 ms]
change: [-7.8350% -7.3778% -6.9367%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) low mild
1 (1.00%) high mild
Benchmarking physical_plan_tpch_q4: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.4s, enable flat sampling, or reduce sample count to 50.
physical_plan_tpch_q4 time: [1.6532 ms 1.6574 ms 1.6617 ms]
change: [-6.2634% -5.5640% -4.9105%] (p = 0.00 <
0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
physical_plan_tpch_q5 time: [2.8426 ms 2.8507 ms 2.8590 ms]
change: [-8.5504% -8.1407% -7.7324%] (p = 0.00 <
0.05)
Performance has improved.
Benchmarking physical_plan_tpch_q6: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 5.8s, enable flat sampling, or reduce sample count to 60.
physical_plan_tpch_q6 time: [1.1498 ms 1.1532 ms 1.1563 ms]
change: [-4.0547% -3.4204% -2.7697%] (p = 0.00 <
0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) low mild
1 (1.00%) high mild
physical_plan_tpch_q7 time: [4.0766 ms 4.0897 ms 4.1029 ms]
change: [-7.1757% -6.7318% -6.2923%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
physical_plan_tpch_q8 time: [5.9329 ms 5.9529 ms 5.9730 ms]
change: [-8.5300% -8.0299% -7.5207%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
physical_plan_tpch_q9 time: [4.4875 ms 4.5015 ms 4.5155 ms]
change: [-7.3168% -6.8709% -6.4349%] (p = 0.00 <
0.05)
Performance has improved.
physical_plan_tpch_q10 time: [2.9242 ms 2.9325 ms 2.9411 ms]
change: [-7.5414% -7.0326% -6.5287%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
physical_plan_tpch_q11 time: [2.3420 ms 2.3486 ms 2.3553 ms]
change: [-5.4976% -5.0941% -4.6762%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
physical_plan_tpch_q12 time: [2.0776 ms 2.0854 ms 2.0939 ms]
change: [-5.0134% -4.5018% -3.9740%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking physical_plan_tpch_q13: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 6.5s, enable flat sampling, or reduce sample count to 60.
physical_plan_tpch_q13 time: [1.2825 ms 1.2861 ms 1.2898 ms]
change: [-6.2738% -5.7308% -5.2177%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
Benchmarking physical_plan_tpch_q14: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.6s, enable flat sampling, or reduce sample count to 50.
physical_plan_tpch_q14 time: [1.6919 ms 1.6980 ms 1.7048 ms]
change: [-15.030% -12.371% -9.8084%] (p = 0.00 <
0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low mild
4 (4.00%) high mild
1 (1.00%) high severe
physical_plan_tpch_q16 time: [2.4186 ms 2.4252 ms 2.4318 ms]
change: [-11.400% -10.767% -10.137%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
physical_plan_tpch_q17 time: [2.2207 ms 2.2270 ms 2.2333 ms]
change: [-5.3964% -5.0215% -4.6541%] (p = 0.00 <
0.05)
Performance has improved.
physical_plan_tpch_q18 time: [2.4501 ms 2.4612 ms 2.4730 ms]
change: [-7.2748% -6.6948% -6.0694%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
physical_plan_tpch_q19 time: [5.5188 ms 5.5361 ms 5.5539 ms]
change: [-3.7142% -3.2374% -2.7330%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
physical_plan_tpch_q20 time: [2.9689 ms 2.9796 ms 2.9906 ms]
change: [-5.3842% -4.9395% -4.4579%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
physical_plan_tpch_q21 time: [4.4561 ms 4.4756 ms 4.4965 ms]
change: [-5.9124% -5.3952% -4.8319%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
physical_plan_tpch_q22 time: [2.1949 ms 2.2018 ms 2.2088 ms]
change: [-3.9778% -3.3629% -2.7916%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking physical_plan_tpch_all: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 6.8s, or reduce sample count to 70.
physical_plan_tpch_all time: [67.107 ms 67.291 ms 67.476 ms]
change: [-7.9768% -7.5521% -7.1246%] (p = 0.00 <
0.05)
Performance has improved.
logical_plan_tpch_all time: [12.417 ms 12.473 ms 12.528 ms]
change: [-3.4870% -2.8011% -2.1019%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) low mild
1 (1.00%) high mild
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
