Rich-T-kid opened a new issue, #24116: URL: https://github.com/apache/datafusion/issues/24116
### Is your feature request related to a problem or challenge? Whether dictionary-encoding a column helps depends not just on its cardinality but on how heavily it's aggregated in the query. There's no existing signal that combines both. ### Describe the solution you'd like Derive metadata that combines NDV with an estimate of aggregation "heaviness" for a given query plan. Heavy aggregation + low NDV = more room for error/benefit if we decide to cast to dictionary arrays early; this signal should be usable by the optimizer. ### Describe alternatives you've considered _No response_ ### Additional context sub-issue of : #22891 part of epic : https://github.com/apache/datafusion/issues/24111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
