[
https://issues.apache.org/jira/browse/SPARK-18503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18503.
-------------------------------
Resolution: Not A Problem
> Pre 2.0 spark driver/executor memory default unit is bytes, post 2.0 default
> unit is MB
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-18503
> URL: https://issues.apache.org/jira/browse/SPARK-18503
> Project: Spark
> Issue Type: Bug
> Components: Deploy
> Affects Versions: 2.0.0, 2.0.1, 2.0.2
> Reporter: Chris McCubbin
> Priority: Minor
>
> Prior to v2.0, Spark's executor memory default unit was in bytes. i.e. if one
> set "spark.executor.memory" to "1000000" this was interpreted as 1,000,000
> bytes if no unit was supplied (like "1m"). This is consistent with the JVM.
> Changes introduced by SPARK-12343 in 2.0 made this default unit MB, so
> "1000000" is interpreted as 1,000,000 MB.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
