Merge pull request #501 from JoshRosen/cartesian-rdd-fixes

Fix two bugs in PySpark cartesian(): SPARK-978 and SPARK-1034

This pull request fixes two bugs in PySpark's `cartesian()` method:

- [SPARK-978](https://spark-project.atlassian.net/browse/SPARK-978): PySpark's 
cartesian method throws ClassCastException exception
- [SPARK-1034](https://spark-project.atlassian.net/browse/SPARK-1034): 
Py4JException on PySpark Cartesian Result

The JIRAs have more details describing the fixes.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/cad3002f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/cad3002f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/cad3002f

Branch: refs/heads/master
Commit: cad3002fead89d3c9a8de4fa989e88f367bc0b05
Parents: fad6aac 6156990
Author: Patrick Wendell <pwend...@gmail.com>
Authored: Thu Jan 23 19:08:34 2014 -0800
Committer: Patrick Wendell <pwend...@gmail.com>
Committed: Thu Jan 23 19:08:34 2014 -0800

----------------------------------------------------------------------
 .../org/apache/spark/api/java/JavaPairRDD.scala |  3 +-
 .../org/apache/spark/api/python/PythonRDD.scala | 59 +++++++++++++-------
 python/pyspark/tests.py                         | 16 ++++++
 3 files changed, 56 insertions(+), 22 deletions(-)
----------------------------------------------------------------------


Reply via email to