andygrove commented on PR #3048:
URL:
https://github.com/apache/datafusion-comet/pull/3048#issuecomment-3716304764
Current performance compared to main branch:
```
cast_string_to_int/legacy/i8
time: [5.9209 µs 5.9392 µs 5.9592 µs]
change: [−11.695% −11.370% −11.025%] (p = 0.00 <
0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
cast_string_to_int/legacy/i16
time: [6.0520 µs 6.0623 µs 6.0752 µs]
change: [−19.180% −16.832% −14.698%] (p = 0.00 <
0.05)
Performance has improved.
cast_string_to_int/legacy/i32
time: [10.351 µs 10.465 µs 10.588 µs]
change: [−8.5234% −7.6387% −6.8160%] (p = 0.00 <
0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
11 (11.00%) low mild
cast_string_to_int/legacy/i64
time: [9.8147 µs 9.8431 µs 9.8750 µs]
change: [−20.510% −20.227% −19.963%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
cast_string_to_int/ansi/i8
time: [5.9662 µs 5.9738 µs 5.9833 µs]
change: [+3.5123% +3.8189% +4.1332%] (p = 0.00 <
0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
5 (5.00%) high mild
11 (11.00%) high severe
cast_string_to_int/ansi/i16
time: [6.0278 µs 6.0633 µs 6.0965 µs]
change: [+4.7100% +5.2768% +5.8408%] (p = 0.00 <
0.05)
Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
17 (17.00%) high mild
1 (1.00%) high severe
cast_string_to_int/ansi/i32
time: [11.561 µs 12.055 µs 12.488 µs]
change: [−4.3485% +0.7326% +5.7014%] (p = 0.77 >
0.05)
No change in performance detected.
cast_string_to_int/ansi/i64
time: [8.9904 µs 9.0207 µs 9.0561 µs]
change: [−12.821% −12.447% −12.056%] (p = 0.00 <
0.05)
Performance has improved.
Found 21 outliers among 100 measurements (21.00%)
6 (6.00%) high mild
15 (15.00%) high severe
cast_string_to_int/try/i8
time: [5.3065 µs 5.3077 µs 5.3088 µs]
change: [−12.228% −11.963% −11.694%] (p = 0.00 <
0.05)
Performance has improved.
cast_string_to_int/try/i16
time: [5.3181 µs 5.3339 µs 5.3510 µs]
change: [−14.996% −12.856% −11.115%] (p = 0.00 <
0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
9 (9.00%) high mild
5 (5.00%) high severe
cast_string_to_int/try/i32
time: [8.9089 µs 8.9433 µs 8.9790 µs]
change: [−23.521% −21.359% −19.212%] (p = 0.00 <
0.05)
Performance has improved.
cast_string_to_int/try/i64
time: [8.9110 µs 8.9753 µs 9.0582 µs]
change: [−33.677% −30.213% −26.785%] (p = 0.00 <
0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
cast_string_to_int/legacy_decimals/i32
time: [10.346 µs 10.361 µs 10.383 µs]
change: [−16.404% −15.946% −15.512%] (p = 0.00 <
0.05)
Performance has improved.
Found 16 outliers among 100 measurements (16.00%)
6 (6.00%) high mild
10 (10.00%) high severe
cast_string_to_int/legacy_decimals/i64
time: [10.409 µs 10.434 µs 10.467 µs]
change: [−18.687% −17.862% −17.208%] (p = 0.00 <
0.05)
Performance has improved.
Found 18 outliers among 100 measurements (18.00%)
7 (7.00%) high mild
11 (11.00%) high severe
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
