Dandandan commented on PR #15591: URL: https://github.com/apache/datafusion/pull/15591#issuecomment-2890549663
> * We perform few large memory allocation in `flat`, but will much more small memory allocations in `blocked` > * The memory no continuous anymore, I think it may be not so friendly for cpu(like cache prefetch?) I wonder what happens if we make it more like at least 1 million or 1MiB (e.g. one) so the effect on cache is smaller? We could optimize a growing strategy for the first allocated `Vec` if memory usage / overhead of first block is a concern. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
