2010YOUY01 commented on PR #16814: URL: https://github.com/apache/datafusion/pull/16814#issuecomment-3126517250
> Personally, I prefer to use `time -v dfbench xxxxx` to get memory information. The main advantage is that it doesn't require any extra compilation of dfbench. Another advantage of this external profiling approach is that we can compare different memory allocators side by side (e.g., `jemalloc` and `mimalloc`). I'm interested in doing this because I've heard that `mimalloc` is not optimized for the most efficient memory usage—for example, if the application only needs 1GB of memory, it might hold >> 1GB to make allocation faster. Additionally, `jemalloc` seems to have a tuning option to optimize for space, which would be great in memory-limited cases. However, this PR's approach allows us to inspect more internal `mimalloc` metrics, which I find interesting too. If there's another external profiling implementation, I'm happy to review it as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
