mapleFU commented on issue #36001: URL: https://github.com/apache/arrow/issues/36001#issuecomment-1584174066
Sorry I'm not so familiar with Ruby code, you can ask kou for how to use it. Personally, I guess if you're reading a local file, I guess buffer-io can provide similiar performance with less io.If you're using S3 or other, batch read without buffer-io might provide better performance, but consumes more memory, because they do less IO. But you can enlarge buffer I/O size to tradeoff. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
