[
https://issues.apache.org/jira/browse/SPARK-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3768.
----------------------------------
Resolution: Fixed
> Modify default YARN memory_overhead-- from an additive constant to a
> multiplier
> -------------------------------------------------------------------------------
>
> Key: SPARK-3768
> URL: https://issues.apache.org/jira/browse/SPARK-3768
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: Thomas Graves
> Assignee: Nishkam Ravi
> Fix For: 1.2.0
>
>
> Related to #894 and https://issues.apache.org/jira/browse/SPARK-2398
> Experiments show that memory_overhead grows with container size. The
> multiplier has been experimentally obtained and can potentially be improved
> over time.
> https://github.com/apache/spark/pull/2485
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
