lidavidm commented on pull request #9802: URL: https://github.com/apache/arrow/pull/9802#issuecomment-809385854
Hmm, I think the behavior is specifically because we're passing a reader, which of course is single-shot. In some cases we can't avoid this (e.g. if you pass in a Flight reader or an iterator). But InMemoryDataset allows passing a record batch iterator _factory_ which we should take advantage of as much as possible, so at least in the case where we get a list of batches, that should be re-readable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
