marsupialtail commented on PR #13640: URL: https://github.com/apache/arrow/pull/13640#issuecomment-1221580853
Note that the current implementation relies on a memcpy to ensure alignment. In general, if each write starts off from a potentially different buffer with an arbitrary length this memcpy is most likely required. This memcpy introduces a 2x slowdown compared to "pure" direct IO where the buffers are all aligned in the first place. It's probably too much to ask for that all Arrow buffers be 4096 aligned, so we might have to live with this memcpy unfortunately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
