maartenbreddels opened a new pull request #8755: URL: https://github.com/apache/arrow/pull/8755
Related https://github.com/vaexio/vaex/pull/1075 With this change, I'm seeing a 5x speedup and still allow for 'classical' .read(). I'm not so sure why the 5x speedup happens, I expected less of a difference. Maybe memoryview.tobytes() doesn't release the GIL. In any case, this makes it possible to create a Python-Land-based file object with great performance. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
