[
https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma reassigned SPARK-2109:
--------------------------------------
Assignee: Prashant Sharma
> Setting SPARK_MEM for bin/pyspark does not work.
> -------------------------------------------------
>
> Key: SPARK-2109
> URL: https://issues.apache.org/jira/browse/SPARK-2109
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Prashant Sharma
> Assignee: Prashant Sharma
> Priority: Critical
> Fix For: 1.0.1, 1.1.0
>
>
> prashant@sc:~/work/spark$ SPARK_MEM=10G bin/pyspark
> Python 2.7.6 (default, Mar 22 2014, 22:59:56)
> [GCC 4.8.2] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> Traceback (most recent call last):
> File "/home/prashant/work/spark/python/pyspark/shell.py", line 43, in
> <module>
> sc = SparkContext(appName="PySparkShell", pyFiles=add_files)
> File "/home/prashant/work/spark/python/pyspark/context.py", line 94, in
> __init__
> SparkContext._ensure_initialized(self, gateway=gateway)
> File "/home/prashant/work/spark/python/pyspark/context.py", line 190, in
> _ensure_initialized
> SparkContext._gateway = gateway or launch_gateway()
> File "/home/prashant/work/spark/python/pyspark/java_gateway.py", line 51,
> in launch_gateway
> gateway_port = int(proc.stdout.readline())
> ValueError: invalid literal for int() with base 10: 'Warning: SPARK_MEM is
> deprecated, please use a more specific config option\n'
--
This message was sent by Atlassian JIRA
(v6.2#6252)
