lidavidm opened a new pull request #10070: URL: https://github.com/apache/arrow/pull/10070
As suggested, this makes a new subclass for datasets that wrap iterators/readers. The difference is not exposed on the Python side. Later, when ARROW-12289 lands, StreamingDataset can return a subclass of Fragment which uses an I/O thread to scan the reader. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
