[
https://issues.apache.org/jira/browse/SPARK-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001316#comment-15001316
]
Chris Howard commented on SPARK-11154:
--------------------------------------
Hi [~tgraves] - this overlaps to a point with
[SPARK-3374|https://issues.apache.org/jira/browse/SPARK-3374] and
[SPARK-4408|https://issues.apache.org/jira/browse/SPARK-4408]
I would agree with [~srowen] that 2.0 provides an opportunity for house keeping
/ consolidation and there is scope to clean up the config / args for cluster
and client modes.
I would prefer not to create new configs and would rather stick with the
current naming and support k | m | g modifiers unless somebody has a strong
view on what to rename the existing configs.
> make specificaition spark.yarn.executor.memoryOverhead consistent with
> typical JVM options
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-11154
> URL: https://issues.apache.org/jira/browse/SPARK-11154
> Project: Spark
> Issue Type: Improvement
> Components: Documentation, Spark Submit
> Reporter: Dustin Cote
> Priority: Minor
>
> spark.yarn.executor.memoryOverhead is currently specified in megabytes by
> default, but it would be nice to allow users to specify the size as though it
> were a typical -Xmx option to a JVM where you can have 'm' and 'g' appended
> to the end to explicitly specify megabytes or gigabytes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
