alamb commented on issue #1532: URL: https://github.com/apache/arrow-datafusion/issues/1532#issuecomment-1008364021
> Will arrow-rs eventually support async file IO? Requiring a synchronous ChuckReader is currently a major limitation in supporting alternate ObjectStores I think someone just needs to put in the effort to make the current `arrow-rs` implementation `async` -- I don't know of any reason it can be done, nor do I know of anyone who plans to do so yet. > at this point should have covered most of all our needs in datafusion as demonstrated in #68. All unit and integration tests are passing at the moment. If this is really true (I haven't checked) it certainly sounds compelling I like the idea of making an official "arrow2" branch in DataFusion, getting some more 👀 on it, and then propose it as a PR to merge to datafusion master. @houqp can you make a PR? Would you like me to? @yjshen ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
