backkem commented on issue #970: URL: https://github.com/apache/arrow-datafusion/issues/970#issuecomment-1795325555
Ok, I can see how that would work. Thank you for the input. I wonder if any of the following are worth upstreaming as a canonical way to handle this 'query federation' case: - A trait to determine if `TableSource`s belong to the same remote execution engine. This could be part of `TableSource` or a separate optional trait next to it. - The `FederationOptimizer` that hands-off plan chunks to the respective remote execution Optimizers. - Some in-ecosystem federation plugins/examples such Flight SQL or ADBC. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
