robtandy commented on issue #37278: URL: https://github.com/apache/arrow/issues/37278#issuecomment-1847987289
Ok that looks right from my digging too. As a work around i can create flight requests and get the results as a recordbatchreader, i'll have multiple of these. Then in duckdb do ``` with T as (select col1, col2, from rbr1 union all by name select colo1, colo2 from rbr2) select col1, col2 from T``` Adding the `with` cte in front of the query gives me the semantics i want which is `select col1, col2 from T` where T resides on multiple servers in arrow in mem. However, you have to do additional work to push down any filters to rbr1, rbr2. So far it seems workable, though my CTE with union all by name will get long. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
