Github user ash211 commented on the pull request:
https://github.com/apache/spark/pull/99#issuecomment-37891403
Digging into this a little more, it looks like SPARK_WORKER_MEMORY is still
used in several places, and SPARK_MASTER_MEMORY is there too. Some of those
are related to YARN, which I've never used. Mesos seems to have its own thing
too.
Can you help me figure out how to configure each thing? I've opened up
https://spark-project.atlassian.net/browse/SPARK-1264 to track what the truth
is and then I'll write that into the documentation.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---