andygrove opened a new issue, #4625: URL: https://github.com/apache/arrow-datafusion/issues/4625
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** I have been working on a join reordering optimization in the logical plan and have this working in Dask SQL, but now that I try and upstream it to DataFusion, I have run into a blocker. The PR relies on accessing underlying table sizes for `TableScan`s in the logical plan. I had previously added the `TableSource.statistics` method that I hoped to leverage for this. The problem that I run into when trying to plumb this through to `ListingTable` is that I need a `SessionContext` and of course, optimizer rules do not have access to that. **Describe the solution you'd like** I am not sure. **Describe alternatives you've considered** An alternative would be to implement this as a physical optimizer rule instead, but then this is not available to Dask SQL. **Additional context** None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
