srowen commented on issue #23672: [SPARK-26750]Estimate memory overhead with multi-cores URL: https://github.com/apache/spark/pull/23672#issuecomment-459368638 I mean, this is the documented default, and it's logged and available for users to see. It's inevitable that it will need to be changed in some cases, as there's no good way to pick the right value all the time as a default. The question is whether there is a better default, but if anything I'd imagine we'd decide a higher default overhead fraction is appropriate, not new logic.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
