[
https://issues.apache.org/jira/browse/SPARK-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangping wu updated SPARK-10660:
--------------------------------
Description: In the *Configuration* section, the
*spark.yarn.driver.memoryOverhead* and *spark.yarn.am.memoryOverhead*‘s
default value should be "driverMemory * 0.10, with minimum of 384" and "AM
memory * 0.10, with minimum of 384" respectively. Because from Spark 1.4.0, the
*MEMORY_OVERHEAD_FACTOR* is set to 0.1.0, not 0.07. (was: In the
*Configuration* section, the *spark.yarn.driver.memoryOverhead* and
*spark.yarn.am.memoryOverhead*‘s default value should be "driverMemory * 0.10,
with minimum of 384" and "AM memory * 0.10, with minimum of 384" respectively.
Because from Spark 1.4.0, the *MEMORY_OVERHEAD_FACTOR* is 0.1.0, not 0.07.)
> Doc describe error in the "Running Spark on YARN" page
> ------------------------------------------------------
>
> Key: SPARK-10660
> URL: https://issues.apache.org/jira/browse/SPARK-10660
> Project: Spark
> Issue Type: Documentation
> Components: Documentation
> Affects Versions: 1.4.0, 1.4.1, 1.5.0
> Reporter: yangping wu
> Priority: Trivial
>
> In the *Configuration* section, the *spark.yarn.driver.memoryOverhead* and
> *spark.yarn.am.memoryOverhead*‘s default value should be "driverMemory *
> 0.10, with minimum of 384" and "AM memory * 0.10, with minimum of 384"
> respectively. Because from Spark 1.4.0, the *MEMORY_OVERHEAD_FACTOR* is set
> to 0.1.0, not 0.07.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
