gabotechs commented on issue #23194: URL: https://github.com/apache/datafusion/issues/23194#issuecomment-4809454985
In `datafusion-distributed`, once this EPIC is finished: - https://github.com/datafusion-contrib/datafusion-distributed/issues/377 (driven by me) And once the worker protocol has been fully abstracted out of gRPC so that there can be an in-memory implementation: - https://github.com/datafusion-contrib/datafusion-distributed/pull/508 (driven by ParadeDB folks) There should be a fully usable single-node AQE implementation that works pretty much out of the box in non-distributed contexts, without requiring materialization to disk. It still requires all the coordination machinery from `datafusion-distributed` though, so I don't think it can be easily factored out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
