Doug Balog created SPARK-9088:
---------------------------------
Summary: spark-class should ignore driver-memory when running in
YARN cluster mode.
Key: SPARK-9088
URL: https://issues.apache.org/jira/browse/SPARK-9088
Project: Spark
Issue Type: Bug
Components: Spark Submit, YARN
Affects Versions: 1.3.1
Environment: YARN cluster-mode
Reporter: Doug Balog
When submitting a spark job via YARN in cluster mode, the jvm started by
spark-class does not need to use --driver-memory XXGB to submit the job to YARN.
The driver started on the YARN cluster must allocate this amount of memory, but
spark-submit on the submitting node does not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
