yjshen commented on issue #1313: URL: https://github.com/apache/arrow-datafusion/issues/1313#issuecomment-970170705
@roeap Yes, we have the migration experiment to arrow2 in https://github.com/apache/arrow-datafusion/pull/68. Currently, the PR is slightly lagging from the master branch, especially for the recently added "ListingTable" that uses the object store API. If you want to start from there, the first thing might be to catch up with the master branch. Then arrow2 already has an async Parquet reader that we could use for async object-store implementation. Another important note from my side: Arrow2 is not an ASF project yet. The best we can achieve for the moment is to maintain datafusion-arrow2 as a separate branch in this repo, and regularly execute chores to synchronize it with the master branch. If this development model suits you, you are very welcome to join us. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
