RE: PySpark to remote cluster

2016-12-01 Thread Schaefers, Klaus
December 1, 2016 12:44 AM To: user@spark.apache.org; Schaefers, Klaus <klaus.schaef...@philips.com> Subject: Re: PySpark to remote cluster Spark 2.0.1 is running with a different py4j library than Spark 1.6. You will probably run into other problems mixing versions though - is there a reas

Re: PySpark to remote cluster

2016-11-30 Thread Felix Cheung
Spark 2.0.1 is running with a different py4j library than Spark 1.6. You will probably run into other problems mixing versions though - is there a reason you can't run Spark 1.6 on the client? _ From: Klaus Schaefers