huangtengfei created SPARK-25261:
------------------------------------

             Summary: Update configuration.md, correct the default units of 
spark.driver|executor.memory
                 Key: SPARK-25261
                 URL: https://issues.apache.org/jira/browse/SPARK-25261
             Project: Spark
          Issue Type: Improvement
          Components: Documentation
    Affects Versions: 2.3.0
            Reporter: huangtengfei


From  
[SparkContext|https://github.com/ivoson/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L464]
 and 
[SparkSubmitCommandBuilder|https://github.com/ivoson/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L265],we
 can see that spark.driver.memory and spark.executor.memory are parsed as bytes 
if no units specified. But in the doc, they are described as mb in default, 
which may lead to some misunderstanding.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to