spark git commit: [SPARK-22119][ML] Add cosine distance to KMeans

2018-01-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 121dc96f0 -> 4f43d27c9 [SPARK-22119][ML] Add cosine distance to KMeans ## What changes were proposed in this pull request? Currently, KMeans assumes the only possible distance measure to be used is the Euclidean. This PR aims to add the

svn commit: r24342 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_21_00_01-121dc96-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Sun Jan 21 08:17:46 2018 New Revision: 24342 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_21_00_01-121dc96 docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24343 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_21_02_01-e0ef30f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Sun Jan 21 10:17:06 2018 New Revision: 24343 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_21_02_01-e0ef30f docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-20947][PYTHON] Fix encoding/decoding error in pipe action

2018-01-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 12faae295 -> 602c6d82d [SPARK-20947][PYTHON] Fix encoding/decoding error in pipe action ## What changes were proposed in this pull request? Pipe action convert objects into strings using a way that was affected by the default encoding

svn commit: r24345 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_21_12_01-2239d7a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Sun Jan 21 20:14:52 2018 New Revision: 24345 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_21_12_01-2239d7a docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24349 - in /dev/spark/2.3.1-SNAPSHOT-2018_01_21_22_01-5781fa7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Mon Jan 22 06:15:43 2018 New Revision: 24349 Log: Apache Spark 2.3.1-SNAPSHOT-2018_01_21_22_01-5781fa7 docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23020][CORE] Fix races in launcher code, test.

2018-01-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8142a3b88 -> ec2289761 [SPARK-23020][CORE] Fix races in launcher code, test. The race in the code is because the handle might update its state to the wrong state if the connection handling thread is still processing incoming data; so the

spark git commit: [SPARK-23169][INFRA][R] Run lintr on the changes of lint-r script and .lintr configuration

2018-01-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 2239d7a41 -> 12faae295 [SPARK-23169][INFRA][R] Run lintr on the changes of lint-r script and .lintr configuration ## What changes were proposed in this pull request? When running the `run-tests` script, seems we don't run lintr on the

svn commit: r24348 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_21_20_01-602c6d8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Mon Jan 22 04:15:20 2018 New Revision: 24348 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_21_20_01-602c6d8 docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22976][CORE] Cluster mode driver dir removed while running

2018-01-21 Thread jshao
Repository: spark Updated Branches: refs/heads/branch-2.3 7520491bf -> 5781fa79e [SPARK-22976][CORE] Cluster mode driver dir removed while running ## What changes were proposed in this pull request? The clean up logic on the worker perviously determined the liveness of a particular

spark git commit: [SPARK-22976][CORE] Cluster mode driver dir removed while running

2018-01-21 Thread jshao
Repository: spark Updated Branches: refs/heads/master 602c6d82d -> 11daeb833 [SPARK-22976][CORE] Cluster mode driver dir removed while running ## What changes were proposed in this pull request? The clean up logic on the worker perviously determined the liveness of a particular applicaiton

spark git commit: [SPARK-21293][SS][SPARKR] Add doc example for streaming join, dedup

2018-01-21 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 4f43d27c9 -> 2239d7a41 [SPARK-21293][SS][SPARKR] Add doc example for streaming join, dedup ## What changes were proposed in this pull request? streaming programming guide changes ## How was this patch tested? manually Author: Felix

spark git commit: [SPARK-21293][SS][SPARKR] Add doc example for streaming join, dedup

2018-01-21 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.3 e0ef30f77 -> 7520491bf [SPARK-21293][SS][SPARKR] Add doc example for streaming join, dedup ## What changes were proposed in this pull request? streaming programming guide changes ## How was this patch tested? manually Author: Felix

spark git commit: [MINOR][SQL] Fix wrong comments on org.apache.spark.sql.parquet.row.attributes

2018-01-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 11daeb833 -> 8142a3b88 [MINOR][SQL] Fix wrong comments on org.apache.spark.sql.parquet.row.attributes ## What changes were proposed in this pull request? This PR fixes the wrong comment on `org.apache.spark.sql.parquet.row.attributes`

spark git commit: [MINOR][SQL] Fix wrong comments on org.apache.spark.sql.parquet.row.attributes

2018-01-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 5781fa79e -> 36af73b59 [MINOR][SQL] Fix wrong comments on org.apache.spark.sql.parquet.row.attributes ## What changes were proposed in this pull request? This PR fixes the wrong comment on `org.apache.spark.sql.parquet.row.attributes`

spark git commit: [SPARK-23020][CORE] Fix races in launcher code, test.

2018-01-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 36af73b59 -> 57c320a0d [SPARK-23020][CORE] Fix races in launcher code, test. The race in the code is because the handle might update its state to the wrong state if the connection handling thread is still processing incoming data; so

svn commit: r24344 - in /dev/spark/2.4.0-SNAPSHOT-2018_01_21_08_01-4f43d27-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-21 Thread pwendell
Author: pwendell Date: Sun Jan 21 16:17:37 2018 New Revision: 24344 Log: Apache Spark 2.4.0-SNAPSHOT-2018_01_21_08_01-4f43d27 docs [This commit notification would consist of 1441 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]