huangtengfei created SPARK-25261:
------------------------------------
Summary: Update configuration.md, correct the default units of
spark.driver|executor.memory
Key: SPARK-25261
URL: https://issues.apache.org/jira/browse/SPARK-25261
Project: Spark
Issue Type: Improvement
Components: Documentation
Affects Versions: 2.3.0
Reporter: huangtengfei
From
[SparkContext|https://github.com/ivoson/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L464]
and
[SparkSubmitCommandBuilder|https://github.com/ivoson/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L265],we
can see that spark.driver.memory and spark.executor.memory are parsed as bytes
if no units specified. But in the doc, they are described as mb in default,
which may lead to some misunderstanding.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]