nevi-me commented on pull request #820:
URL: https://github.com/apache/arrow-rs/pull/820#issuecomment-937370923
@alamb this is on top of #818.
I'm seeing the below perf change on my machine, so around double the
throughput:
```rust
write_batch primitive/65536 values string
time: [12.672 ms 12.726 ms 12.784 ms]
thrpt: [99.036 MiB/s 99.490 MiB/s 99.911 MiB/s]
change:
time: [-52.187% -51.249% -50.437%] (p = 0.00 <
0.05)
thrpt: [+101.76% +105.12% +109.15%]
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
write_batch primitive/65536 values string non-null
time: [13.294 ms 13.354 ms 13.418 ms]
thrpt: [94.355 MiB/s 94.808 MiB/s 95.237 MiB/s]
change:
time: [-56.007% -55.726% -55.459%] (p = 0.00 <
0.05)
thrpt: [+124.51% +125.86% +127.31%]
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
write_batch nested/65536 values primitive list
time: [26.239 ms 26.374 ms 26.522 ms]
thrpt: [97.448 MiB/s 97.995 MiB/s 98.496 MiB/s]
change:
time: [-35.495% -34.704% -34.028%] (p = 0.00 <
0.05)
thrpt: [+51.579% +53.148% +55.026%]
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
3 (3.00%) low mild
5 (5.00%) high mild
4 (4.00%) high severe
write_batch nested/65536 values primitive list non-null
time: [30.944 ms 31.093 ms 31.245 ms]
thrpt: [81.966 MiB/s 82.367 MiB/s 82.763 MiB/s]
change:
time: [-44.806% -41.555% -38.966%] (p = 0.00 <
0.05)
thrpt: [+63.843% +71.100% +81.181%]
Performance has improved.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
