svn commit: r25180 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_21_00_01-c8c4441-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Wed Feb 21 08:15:13 2018 New Revision: 25180 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_21_00_01-c8c4441 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r25210 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_21_16_01-744d5af-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Thu Feb 22 00:15:45 2018 New Revision: 25210 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_21_16_01-744d5af docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22700][ML] Bucketizer.transform incorrectly drops row containing NaN - for branch-2.2

2018-02-21 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.2 a95c3e29d -> 1cc34f3e5 [SPARK-22700][ML] Bucketizer.transform incorrectly drops row containing NaN - for branch-2.2 ## What changes were proposed in this pull request? for branch-2.2 only drops the rows containing NaN in the input

spark git commit: [SPARK-23481][WEBUI] lastStageAttempt should fail when a stage doesn't exist

2018-02-21 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.3 373ac642f -> 23ba4416e [SPARK-23481][WEBUI] lastStageAttempt should fail when a stage doesn't exist ## What changes were proposed in this pull request? The issue here is `AppStatusStore.lastStageAttempt` will return the next

svn commit: r25211 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_21_18_01-23ba441-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Thu Feb 22 02:15:44 2018 New Revision: 25211 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_21_18_01-23ba441 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23481][WEBUI] lastStageAttempt should fail when a stage doesn't exist

2018-02-21 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 3fd0ccb13 -> 744d5af65 [SPARK-23481][WEBUI] lastStageAttempt should fail when a stage doesn't exist ## What changes were proposed in this pull request? The issue here is `AppStatusStore.lastStageAttempt` will return the next available

spark git commit: [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader

2018-02-21 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.3 3e7269eb9 -> 373ac642f [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader ## What changes were proposed in this pull request? var `KafkaContinuousReader.knownPartitions` should be threadsafe as it is accessed from

spark git commit: [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader

2018-02-21 Thread tdas
Repository: spark Updated Branches: refs/heads/master e836c27ce -> 3fd0ccb13 [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader ## What changes were proposed in this pull request? var `KafkaContinuousReader.knownPartitions` should be threadsafe as it is accessed from

svn commit: r25212 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_21_20_01-45cf714-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Thu Feb 22 04:15:58 2018 New Revision: 25212 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_21_20_01-45cf714 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r25213 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_21_22_01-a0d7949-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Thu Feb 22 06:15:16 2018 New Revision: 25213 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_21_22_01-a0d7949 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23475][WEBUI] Skipped stages should be evicted before completed stages

2018-02-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 23ba4416e -> a0d794989 [SPARK-23475][WEBUI] Skipped stages should be evicted before completed stages ## What changes were proposed in this pull request? The root cause of missing completed stages is because `cleanupStages` will never

spark git commit: [SPARK-23475][WEBUI] Skipped stages should be evicted before completed stages

2018-02-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 744d5af65 -> 45cf714ee [SPARK-23475][WEBUI] Skipped stages should be evicted before completed stages ## What changes were proposed in this pull request? The root cause of missing completed stages is because `cleanupStages` will never

svn commit: r25201 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_21_12_01-e836c27-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-21 Thread pwendell
Author: pwendell Date: Wed Feb 21 20:15:36 2018 New Revision: 25201 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_21_12_01-e836c27 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23217][ML][PYTHON] Add distanceMeasure param to ClusteringEvaluator Python API

2018-02-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master c8c4441df -> e836c27ce [SPARK-23217][ML][PYTHON] Add distanceMeasure param to ClusteringEvaluator Python API ## What changes were proposed in this pull request? The PR adds the `distanceMeasure` param to ClusteringEvaluator in the Python