Dandandan commented on PR #15591: URL: https://github.com/apache/datafusion/pull/15591#issuecomment-2890775426
> We make the block size large enough For the first block, we still perform resizing at firstly But after it grow large enough, we switch to blocked approach? Yes - exactly! Alternatively maybe we even can switch from flat to block approach after reaching a certain threshold (for example 1 million groups) to avoid overhead of the block approach on lower cardinality cases? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
