spark git commit: [SPARK-4548] []SPARK-4517] improve performance of python broadcast

2014-11-24 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 8371bc208 - 841f247a5 [SPARK-4548] []SPARK-4517] improve performance of python broadcast Re-implement the Python broadcast using file: 1) serialize the python object using cPickle, write into disks. 2) Create a wrapper in JVM (for the

spark git commit: [SPARK-4548] []SPARK-4517] improve performance of python broadcast

2014-11-24 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 050616b40 - 6cf507685 [SPARK-4548] []SPARK-4517] improve performance of python broadcast Re-implement the Python broadcast using file: 1) serialize the python object using cPickle, write into disks. 2) Create a wrapper in JVM (for the