asolimando commented on issue #24117: URL: https://github.com/apache/datafusion/issues/24117#issuecomment-5373141861
> Something that popped into mind is looking at any filters in the physical plan to determine if its worth converting to a dictionary a well. for example a filter that retains a 'small' set of values that is later aggregated may benefit from `dict<k,v>` As discussed offline, I agree it's important but I think relying on existing statistics propagation around `distinct_count`/NDV will be enough to that effect, you'd just need to "consume" the statistics propagated bottom-up in the subplan. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
