nevi-me commented on pull request #9825:
URL: https://github.com/apache/arrow/pull/9825#issuecomment-808866545
I also need the benchmarks so I can use them as guidance when clearing the
TODOs that are still in the writer code.
I'm getting the below, feels very slow to me, but I don't yet know how fast
the C++ writer is (@emkornfield do you have an idea?):
```
write_batch primitive/1024 values
time: [1.0473 ms 1.0505 ms 1.0539 ms]
thrpt: [95.109 MiB/s 95.415 MiB/s 95.708 MiB/s]
write_batch primitive/4096 values
time: [4.3952 ms 4.4335 ms 4.4851 ms]
thrpt: [87.996 MiB/s 89.020 MiB/s 89.795 MiB/s]
```
I might not be calculating the throughput values correctly, but I'll check
that separately (it'd be useful to know the size of a recordbatch).
CC @houqp
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
