mrocklin commented on issue #38389: URL: https://github.com/apache/arrow/issues/38389#issuecomment-1774919572
Turning threads off I get around 170MB/s on my linux machine, 600 MB/s on my OS-X machine. > as I get around 250-300 MB/s using use_threads=False. I'm curious, for deserializing integers is this expected performance? I would have thought that for this kind of data (just ints) we'd be closer to GB/s speeds. I'm curious, what is the slow part here? Is there some intense compression or something? > have you used the same conda forge build for your measurements or did you build it yourself? It would be nice to rule out any build differences I'm also quite curious about this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
