alamb commented on PR #5362: URL: https://github.com/apache/arrow-datafusion/pull/5362#issuecomment-1441737279
>> using a cost model to choose between the plans -- but DataFusion doesn't have this feature at the moment > That was exactly where I foresaw this going. I was aware we merged some cost-based optimization logic recently. If exposing those stats along with the index is the correct direction, I'd be happy to start looking into that. I agree that the usecase of DataFusion to cost out multiple possible TableScans (e.g. using different indexes) as part of the overall plan makes sense, though I am not sure if this PR's interface is ideal for that scenario -- it seems more like we could model the different paths as potentially different TableProviders might be more natural -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
