tustvold commented on issue #2489: URL: https://github.com/apache/arrow-datafusion/issues/2489#issuecomment-1127525138
Yeah, buffered prefetch is one way to mitigate the small read problem. However, it does not allow for coalescing adjacent reads - i.e. you will still likely end up with one request per column chunk unless you have tiny columns. TBC my preference is for 3, but I'm currently working on 2 first to ensure there aren't any fundamental integration issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
