alamb commented on issue #17169: URL: https://github.com/apache/datafusion/issues/17169#issuecomment-3189084096
I think there are two issues we should explore: 1. Keeping within the memory budget (basically make the accounting better when possible) 2. Improving DataFusion's ability to deduplicate data with less memory Maybe we could come up with a better operator that specializes with deduplication (basically for queries with only GROUP BY and no aggregations) 🤔 maybe @2010YOUY01 or @rluvaton have some thoughts on the latter -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
