neilconway commented on PR #20344:
URL: https://github.com/apache/datafusion/pull/20344#issuecomment-3898912516
```
$ cbench --bench replace -p datafusion-functions -- --baseline
replace-vanilla
Compiling datafusion-functions v52.1.0
(/Users/neilconway/datafusion/datafusion/functions)
Finished `bench` profile [optimized] target(s) in 58.12s
Running benches/replace.rs
(target/release/deps/replace-afa20c157fb54d9b)
Gnuplot not found, using plotters backend
replace size=1024/replace_string_ascii_single [size=1024, str_len=32]
time: [18.134 µs 18.349 µs 18.717 µs]
change: [−15.305% −14.044% −12.138%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) low mild
1 (10.00%) high severe
replace size=1024/replace_string_view [size=1024, str_len=32]
time: [22.343 µs 22.683 µs 23.259 µs]
change: [+0.3520% +1.9019% +4.6616%] (p = 0.11 >
0.05)
No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=1024/replace_string [size=1024, str_len=32]
time: [20.635 µs 20.896 µs 21.280 µs]
change: [−5.8411% −4.4585% −2.5547%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=1024/replace_large_string [size=1024, str_len=32]
time: [21.394 µs 21.617 µs 21.980 µs]
change: [−2.8252% −1.7031% +0.0383%] (p = 0.04 <
0.05)
Change within noise threshold.
Found 3 outliers among 10 measurements (30.00%)
2 (20.00%) low severe
1 (10.00%) high severe
replace size=1024/replace_string_ascii_single [size=1024, str_len=128]
time: [10.551 µs 11.300 µs 12.788 µs]
change: [−51.884% −48.354% −41.375%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=1024/replace_string_view [size=1024, str_len=128]
time: [31.802 µs 32.092 µs 32.439 µs]
change: [+3.6307% +4.7362% +5.9112%] (p = 0.00 <
0.05)
Performance has regressed.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
replace size=1024/replace_string [size=1024, str_len=128]
time: [30.087 µs 30.326 µs 30.624 µs]
change: [+0.2410% +1.1374% +2.2583%] (p = 0.05 <
0.05)
Change within noise threshold.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
replace size=1024/replace_large_string [size=1024, str_len=128]
time: [30.279 µs 30.572 µs 30.911 µs]
change: [+0.7303% +1.8206% +3.0858%] (p = 0.01 <
0.05)
Change within noise threshold.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
replace size=4096/replace_string_ascii_single [size=4096, str_len=32]
time: [70.817 µs 71.706 µs 73.396 µs]
change: [−13.340% −12.030% −9.6396%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=4096/replace_string_view [size=4096, str_len=32]
time: [90.853 µs 91.950 µs 93.956 µs]
change: [+1.1398% +2.4329% +4.7024%] (p = 0.02 <
0.05)
Performance has regressed.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=4096/replace_string [size=4096, str_len=32]
time: [84.413 µs 85.123 µs 86.402 µs]
change: [−5.0557% −4.0771% −2.5094%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=4096/replace_large_string [size=4096, str_len=32]
time: [86.660 µs 87.417 µs 88.730 µs]
change: [−5.2201% −4.3154% −2.8427%] (p = 0.00 <
0.05)
Performance has improved.
Found 4 outliers among 10 measurements (40.00%)
2 (20.00%) low mild
1 (10.00%) high mild
1 (10.00%) high severe
replace size=4096/replace_string_ascii_single [size=4096, str_len=128]
time: [37.600 µs 40.606 µs 46.602 µs]
change: [−52.736% −48.715% −41.063%] (p = 0.00 <
0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
replace size=4096/replace_string_view [size=4096, str_len=128]
time: [141.02 µs 143.11 µs 145.20 µs]
change: [+5.2771% +7.3517% +9.5694%] (p = 0.00 <
0.05)
Performance has regressed.
replace size=4096/replace_string [size=4096, str_len=128]
time: [137.23 µs 138.61 µs 140.22 µs]
change: [+2.7179% +5.2284% +7.6082%] (p = 0.00 <
0.05)
Performance has regressed.
replace size=4096/replace_large_string [size=4096, str_len=128]
time: [137.11 µs 139.20 µs 141.63 µs]
change: [+0.1422% +2.1867% +4.5503%] (p = 0.09 >
0.05)
No change in performance detected.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
