cpcloud commented on issue #440: URL: https://github.com/apache/arrow-datafusion-python/issues/440#issuecomment-1653362679
This looks like a great idea! I'd like to propose that [ibis](https://ibis-project.org) is the library that solves the problem of bringing a delightful and expressive DataFrame API to [DataFusion](https://ibis-project.org/backends/datafusion/) with no loss of SQL functionality. You can actually mix and match ibis expressions and SQL to your heart's content. As @mesejo mentioned, they've been making [great contributions to the DataFusion backend](https://github.com/ibis-project/ibis/pulls?q=is%3Apr+sort%3Aupdated-desc+datafusion+author%3Amesejo+is%3Aclosed) so there's currently some momentum that we can take advantage of. I'll be up front about it: there's still a lot of work to do, the DataFusion backend is missing a lot of functionality. The good news is that we've made really easy to see what functionality is missing from any given backend using [our backend support matrix app](https://ibis-project.org/backends/_support_matrix/). Anyone can take a pass at implementing the operations that have a 🚫 in the `datafusion` column. Some operations will be more challenging than others, and the ibis maintainers (@kszucs, @gforsyth, @jcrist and myself) are here to help. What do say we ... `COALESCE` :wink: around ibis as *the* DataFrame API for DataFusion? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
