Shekhar Bansal created SPARK-5861:
-------------------------------------
Summary: [yarn-client mode] Application master should not use
memory = spark.driver.memory
Key: SPARK-5861
URL: https://issues.apache.org/jira/browse/SPARK-5861
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.2.1
Reporter: Shekhar Bansal
Fix For: 1.3.0, 1.2.2
I am using {code}spark.driver.memory=6g{code}, which creates application master
of 7g(yarn.scheduler.minimum-allocation-mb=1024), which is waste of resources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]