Kay Ousterhout created SPARK-1466: ------------------------------------- Summary: Pyspark doesn't check if gateway process launches correctly Key: SPARK-1466 URL: https://issues.apache.org/jira/browse/SPARK-1466 Project: Spark Issue Type: Bug Components: PySpark Affects Versions: 0.9.0, 0.9.1 Reporter: Kay Ousterhout Assignee: Kay Ousterhout Fix For: 1.0.0
If the gateway process fails to start correctly (e.g., because JAVA_HOME isn't set correctly, there's no Spark jar, etc.), right now pyspark fails because of a very difficult-to-understand error, where we try to parse stdout to get the port where Spark started and there's nothing there. We should properly catch the error, print it to the user, and exit. -- This message was sent by Atlassian JIRA (v6.2#6252)