spark git commit: [SPARK-23841][ML] NodeIdCache should unpersist the last cached nodeIdsForInstances

2018-04-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 649888415 -> 95034af69 [SPARK-23841][ML] NodeIdCache should unpersist the last cached nodeIdsForInstances ## What changes were proposed in this pull request? unpersist the last cached nodeIdsForInstances in `deleteAllCheckpoints` ## How

svn commit: r26270 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_10_08_02-95034af-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-10 Thread pwendell
Author: pwendell Date: Tue Apr 10 15:24:42 2018 New Revision: 26270 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_10_08_02-95034af docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23864][SQL] Add unsafe object writing to UnsafeWriter

2018-04-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 95034af69 -> 3323b156f [SPARK-23864][SQL] Add unsafe object writing to UnsafeWriter ## What changes were proposed in this pull request? This PR moves writing of `UnsafeRow`, `UnsafeArrayData` & `UnsafeMapData` out of the

spark git commit: [SPARK-19724][SQL][FOLLOW-UP] Check location of managed table when ignoreIfExists is true

2018-04-10 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3323b156f -> e17965891 [SPARK-19724][SQL][FOLLOW-UP] Check location of managed table when ignoreIfExists is true ## What changes were proposed in this pull request? In the PR #20886, I mistakenly check the table location only when

spark git commit: [SPARK-23751][ML][PYSPARK] Kolmogorov-Smirnoff test Python API in pyspark.ml

2018-04-10 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master e17965891 -> adb222b95 [SPARK-23751][ML][PYSPARK] Kolmogorov-Smirnoff test Python API in pyspark.ml ## What changes were proposed in this pull request? Kolmogorov-Smirnoff test Python API in `pyspark.ml` **Note** API with `CDF` is a

svn commit: r26274 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_10_12_01-adb222b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-10 Thread pwendell
Author: pwendell Date: Tue Apr 10 19:16:22 2018 New Revision: 26274 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_10_12_01-adb222b docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23871][ML][PYTHON] add python api for VectorAssembler handleInvalid

2018-04-10 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master adb222b95 -> 4f1e8b9bb [SPARK-23871][ML][PYTHON] add python api for VectorAssembler handleInvalid ## What changes were proposed in this pull request? add python api for VectorAssembler handleInvalid ## How was this patch tested? Add

svn commit: r26278 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_10_16_01-4f1e8b9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-10 Thread pwendell
Author: pwendell Date: Tue Apr 10 23:16:29 2018 New Revision: 26278 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_10_16_01-4f1e8b9 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26266 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_10_00_04-6498884-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-10 Thread pwendell
Author: pwendell Date: Tue Apr 10 07:20:50 2018 New Revision: 26266 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_10_00_04-6498884 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark-website git commit: add merge script

2018-04-10 Thread felixcheung
Repository: spark-website Updated Branches: refs/heads/asf-site b75134190 -> 91b561749 add merge script Ported the merge script from spark main repo Author: Felix Cheung Closes #105 from felixcheung/merge. Project:

svn commit: r26279 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_10_20_01-7c7570d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-10 Thread pwendell
Author: pwendell Date: Wed Apr 11 03:16:08 2018 New Revision: 26279 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_10_20_01-7c7570d docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23944][ML] Add the set method for the two LSHModel

2018-04-10 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 4f1e8b9bb -> 7c7570d46 [SPARK-23944][ML] Add the set method for the two LSHModel ## What changes were proposed in this pull request? Add two set method for LSHModel in LSH.scala, BucketedRandomProjectionLSH.scala, and MinHashLSH.scala