Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/894#issuecomment-44321974
The constant xxx mb overhead is to account for things like off vm
overheads, interned strings, other native overheads, etc.
These are fairly small and reasonably constant.
Making it a function of vm max heap is not advisable particularly when
There is no direct correlation between both.
Worst case, make it configurable constant - not dependent on Xmx
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
