andygrove commented on issue #1558: URL: https://github.com/apache/datafusion-comet/issues/1558#issuecomment-2743701803
> When enabling off-heap memory, we will use unified memory manager, does that mean the amount of memory will not be doubled? Our current implementation automatically allocates extra memory when running Spark in on-heap mode if the user does not explicitly specify `spark.comet.memoryOverhead`. We do not do anything like this for Spark off-heap mode and require the user to explicitly set the amount of memory to be shared between Spark and Comet by setting `spark.memory.offHeap.size`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
