lidavidm commented on pull request #9482: URL: https://github.com/apache/arrow/pull/9482#issuecomment-781593596
> So `PreBuffer` needs to be called once and only once on a reader? It seems this could be simplified if `PreBuffer` didn't immediately start reading (and waited for the first request) although I suppose that may only push the flag further down. It can be called multiple times, but all readers created from the file prior to the next call must be discarded first. Also, you may want PreBuffer to start work immediately: you could pipeline decoding and I/O that way (start prebuffering immediately, then create and sequentially decode the row groups). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
