alamb edited a comment on pull request #68: URL: https://github.com/apache/arrow-datafusion/pull/68#issuecomment-917611641
> Since we will finally move to arrow2/parquet2, at the same time, it might be quite a lot of work for the current parquet to adapt for async reading. I suppose I shouldn't waste @alamb time on this. Moving datafusion to arrow2 definitely sounds like an approach to getting an async parquet reader. Depending on how trickey that proves, another approach might be to follow the path blazed by @jorgecarleitao in https://github.com/jorgecarleitao/arrow2/pull/260 (that adds async parquet reading to arrow2) to add async reading to the existing parquet crate. I tried to write up some thoughts on https://github.com/apache/arrow-rs/issues/111#issuecomment-917611415 > I can devote non-trivial amounts of time to working on this PR, accelerating its maturity, and finally getting merged. @houqp could you share the progress currently and assign me anything that you think necessary? Thanks! That is awesome @yjshen ! Thank you again for all your help and contribution in this area -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
