RE: PySpark to remote cluster

2016-12-01 Thread Schaefers, Klaus
December 1, 2016 12:44 AM To: user@spark.apache.org; Schaefers, Klaus Subject: Re: PySpark to remote cluster Spark 2.0.1 is running with a different py4j library than Spark 1.6. You will probably run into other problems mixing versions though - is there a reason you can't run Spark 1.

Re: PySpark to remote cluster

2016-11-30 Thread Felix Cheung
t;> Sent: Wednesday, November 30, 2016 2:44 AM Subject: PySpark to remote cluster To: mailto:user@spark.apache.org>> Hi, I want to connect with a local Jupyter Notebook to a remote Spark cluster. The Cluster is running Spark 2.0.1 and the Jupyter notebook is based on Spark 1.6 and running

PySpark to remote cluster

2016-11-30 Thread Klaus Schaefers
ement", (lnum, 0)) tokenize.TokenError: ('EOF in multi-line statement', (2, 0)) Is this error caused by the different spark versions? Best, Klaus -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/PySpark-to-remote-cluster-tp28147.html Sent f