timsaucer commented on issue #13274: URL: https://github.com/apache/datafusion/issues/13274#issuecomment-2462653001
I don't know if this discussion is the place we want to track work in the other related projects, but my top goals for 2024 Q4 are: - Get the `datafusion-python` and `delta-rs` integration over the line using FFI https://github.com/apache/datafusion-python/pull/921 - Adding a user tutorial for `datafusion-python` https://github.com/apache/datafusion-python/issues/842 - Evaluating cuDF integration either in `datafusion-python` or `datafusion` https://github.com/apache/datafusion-python/issues/936 - this might be Q1 2025 - Adding `QueryPlanner` to `datafusion-python` and implementing a custom query planner in `datafusion-ray` so that we can run all datafusion commands that perform `execute()` on the dataframe and it just *knows* to how to run them distributed - Probably looking to expose more of the `SessionContext` via FFI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
