Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22252#discussion_r213708177
--- Diff: docs/configuration.md ---
@@ -152,7 +152,7 @@ of the most common options to set are:
<td><code>spark.driver.memory</code></td>
<td>1g</td>
<td>
- Amount of memory to use for the driver process, i.e. where
SparkContext is initialized, in MiB
+ Amount of memory to use for the driver process, i.e. where
SparkContext is initialized, in bytes
--- End diff --
I think I got the point you want to report @ivoson, IIUC, this is a bug in
the code not in doc, we should also make `spark.driver.memory=1024` with the
unit of MiB, maybe this change the original behavior and we can announce in
migrate guide? cc @srowen @HyukjinKwon.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
