adriangb commented on PR #7015:
URL: https://github.com/apache/arrow-rs/pull/7015#issuecomment-2731786354
I pushed dcfae68 and here's what I get from `git checkout main && cargo
bench --bench json_writer -- --save-baseline main && git checkout arrow-union
&& cargo bench --bench json_writer -- --baseline=main` (sorry for not using
criptcmp, could not get it to do what I want):
```
bench_integer time: [2.8701 ms 2.9021 ms 2.9518 ms]
change: [-1.0003% +1.4133% +3.6346%] (p = 0.26 >
0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
bench_float time: [3.3993 ms 3.4496 ms 3.5122 ms]
change: [+2.0880% +3.6490% +5.7300%] (p = 0.00 <
0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
bench_string time: [8.6580 ms 8.7945 ms 8.9765 ms]
change: [+1.4659% +3.3027% +5.6227%] (p = 0.00 <
0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
bench_mixed time: [11.691 ms 11.767 ms 11.846 ms]
change: [-0.7671% +0.1921% +1.2132%] (p = 0.71 >
0.05)
No change in performance detected.
bench_dict_array time: [4.4199 ms 4.4658 ms 4.5184 ms]
change: [+3.6129% +4.9766% +6.3930%] (p = 0.00 <
0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
bench_struct time: [18.621 ms 18.735 ms 18.867 ms]
change: [+1.1160% +1.9472% +2.7869%] (p = 0.00 <
0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
bench_nullable_struct time: [8.9303 ms 8.9962 ms 9.0710 ms]
change: [-0.5520% +0.3707% +1.3565%] (p = 0.46 >
0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
bench_list time: [26.674 ms 26.809 ms 26.957 ms]
change: [-0.4316% +0.2764% +1.0098%] (p = 0.46 >
0.05)
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
bench_nullable_list time: [5.5016 ms 5.5505 ms 5.6046 ms]
change: [-0.9382% +0.3661% +1.6491%] (p = 0.57 >
0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
bench_struct_list time: [2.8141 ms 2.8451 ms 2.8775 ms]
change: [+0.4203% +2.2760% +4.2258%] (p = 0.02 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
