ozgrakkurt commented on PR #4441:
URL: https://github.com/apache/arrow-rs/pull/4441#issuecomment-1609749650
Also compiler can't enable avx unless compiled with `target-cpu=native`
which is very unlikely in cloud situations. But can do pretty well with aarch64
and sse I think
<details>
<summary>benchmarks on 4 AMD EPYC cores</summary>
parquet2 insert time: [21.260 ns 21.743 ns 22.242 ns]
change: [-6.7189% -4.0742% -1.4153%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
parquet insert time: [14.298 ns 14.501 ns 14.721 ns]
change: [-0.4325% +1.8520% +4.1458%] (p = 0.12 >
0.05)
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
sbbf-rs insert time: [3.5763 ns 3.6755 ns 3.8263 ns]
change: [-0.4673% +3.0805% +7.1155%] (p = 0.11 >
0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
parquet2 contains time: [6.1688 ns 6.2463 ns 6.3320 ns]
change: [-0.4251% +1.4917% +3.4157%] (p = 0.12 >
0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
parquet contains time: [6.4125 ns 6.5060 ns 6.6049 ns]
change: [-1.6971% +0.1722% +1.9752%] (p = 0.86 >
0.05)
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
sbbf-rs contains time: [2.5523 ns 2.6273 ns 2.7069 ns]
change: [-3.0901% +1.4871% +6.1788%] (p = 0.53 >
0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]