comphead commented on PR #20682: URL: https://github.com/apache/datafusion/pull/20682#issuecomment-4013453890
Thanks @Omega359 and @Dandandan — the motivation mostly comes from DuckDB, which uses jemalloc by default. In practice this means: - tests run with jemalloc - the shipped DuckDB distribution also uses jemalloc Docs: https://duckdb.org/docs/stable/guides/performance/environment#memory-allocator https://duckdb.org/docs/stable/core_extensions/jemalloc The advantage is that tests and the shipped binary run with the same allocator. If we think mimalloc works better (we also use it in Comet), it might make sense to make it the default allocator everywhere so tests and production match, also update documentation. WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
