Github user ivoson commented on a diff in the pull request:
https://github.com/apache/spark/pull/22252#discussion_r213546414
--- Diff: docs/configuration.md ---
@@ -152,7 +152,7 @@ of the most common options to set are:
<td><code>spark.driver.memory</code></td>
<td>1g</td>
<td>
- Amount of memory to use for the driver process, i.e. where
SparkContext is initialized, in MiB
+ Amount of memory to use for the driver process, i.e. where
SparkContext is initialized, in bytes
--- End diff --
If we start a job with conf spark.executor.memory=1024 or
spark.driver.memory=1024, it means 1024 bytes for now. So I think we should
update the doc to avoid confusion for spark users.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
