Thomas Graves created SPARK-3768:
------------------------------------
Summary: Modify default YARN memory_overhead-- from an additive
constant to a multiplier
Key: SPARK-3768
URL: https://issues.apache.org/jira/browse/SPARK-3768
Project: Spark
Issue Type: Improvement
Components: YARN
Affects Versions: 1.1.0
Reporter: Thomas Graves
Assignee: Nishkam Ravi
Fix For: 1.2.0
Related to #894 and https://issues.apache.org/jira/browse/SPARK-2398
Experiments show that memory_overhead grows with container size. The multiplier
has been experimentally obtained and can potentially be improved over time.
https://github.com/apache/spark/pull/2485
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
