spark git commit: [SPARK-12044][SPARKR] Fix usage of isnan, isNaN

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 6979edf4e -> b6e8e63a0 [SPARK-12044][SPARKR] Fix usage of isnan, isNaN 1, Add ```isNaN``` to ```Column``` for SparkR. ```Column``` should has three related variable functions: ```isNaN, isNull, isNotNull```. 2, Replace ```DataFrame.isNaN``

spark git commit: [SPARK-12044][SPARKR] Fix usage of isnan, isNaN

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 04dfaa6d5 -> 2feac49fb [SPARK-12044][SPARKR] Fix usage of isnan, isNaN 1, Add ```isNaN``` to ```Column``` for SparkR. ```Column``` should has three related variable functions: ```isNaN, isNull, isNotNull```. 2, Replace ```DataFrame.isN

spark git commit: [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 664694b28 -> 04dfaa6d5 [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python Change ```numPartitions()``` to ```getNumPartitions()``` to be consistent with Scala/Python. Note: If we can

spark git commit: [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 895b6c474 -> 6979edf4e [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python Change ```numPartitions()``` to ```getNumPartitions()``` to be consistent with Scala/Python. Note: If we can not

spark git commit: [SPARK-11715][SPARKR] Add R support corr for Column Aggregration

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master c8d0e160d -> 895b6c474 [SPARK-11715][SPARKR] Add R support corr for Column Aggregration Need to match existing method signature Author: felixcheung Closes #9680 from felixcheung/rcorr. Project: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-11715][SPARKR] Add R support corr for Column Aggregration

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 57d16403e -> 664694b28 [SPARK-11715][SPARKR] Add R support corr for Column Aggregration Need to match existing method signature Author: felixcheung Closes #9680 from felixcheung/rcorr. (cherry picked from commit 895b6c474735d7e0a382

spark git commit: [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 7da674851 -> c8d0e160d [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR. Author: Sun Rui Closes #9804 from sun-rui/SPARK-11774. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://g

spark git commit: [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

2015-12-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 39d5cc8ad -> 57d16403e [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR. Author: Sun Rui Closes #9804 from sun-rui/SPARK-11774. (cherry picked from commit c8d0e160dadf3b23c5caa379ba9ad5547794eaa0) Sig

spark git commit: [SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7

2015-12-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master e9c9ae22b -> 7da674851 [SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7 Update JPMML pmml-model to 1.2.7 Author: Sean Owen Closes #9972 from srowen/SPARK-11988. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://gi

spark git commit: [SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max

2015-12-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master ee94b70ce -> e9c9ae22b [SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max Author: Antonio Murgia Closes #9989 from tmnd1991/SPARK-11932. Project: http://git-w

spark git commit: [SPARK-12096][MLLIB] remove the old constraint in word2vec

2015-12-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3af53e61f -> ee94b70ce [SPARK-12096][MLLIB] remove the old constraint in word2vec jira: https://issues.apache.org/jira/browse/SPARK-12096 word2vec now can handle much bigger vocabulary. The old constraint vocabSize.toLong * vectorSize < In