spark git commit: [SPARK-23847][FOLLOWUP][PYTHON][SQL] Actually test [desc|acs]_nulls_[first|last] functions in PySpark

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 7c7570d46 -> c7622befd [SPARK-23847][FOLLOWUP][PYTHON][SQL] Actually test [desc|acs]_nulls_[first|last] functions in PySpark ## What changes were proposed in this pull request? There was a mistake in `tests.py` missing `assertEquals`.

svn commit: r26288 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_06_01-320269e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 13:16:09 2018 New Revision: 26288 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_06_01-320269e docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [MINOR][DOCS] Fix R documentation generation instruction for roxygen2

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master c7622befd -> 87611bba2 [MINOR][DOCS] Fix R documentation generation instruction for roxygen2 ## What changes were proposed in this pull request? This PR proposes to fix `roxygen2` to `5.0.1` in `docs/README.md` for SparkR documentation

spark git commit: [MINOR][DOCS] Fix R documentation generation instruction for roxygen2

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 0f2aabc6b -> 320269e49 [MINOR][DOCS] Fix R documentation generation instruction for roxygen2 ## What changes were proposed in this pull request? This PR proposes to fix `roxygen2` to `5.0.1` in `docs/README.md` for SparkR

spark git commit: [SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient

2018-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c604d659e -> 271c891b9 [SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient ## What changes were proposed in this pull request? Mark `HashAggregateExec.bufVars` as transient to avoid it from being serialized. Also

spark git commit: [SPARK-23951][SQL] Use actual java class instead of string representation.

2018-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 87611bba2 -> c604d659e [SPARK-23951][SQL] Use actual java class instead of string representation. ## What changes were proposed in this pull request? This PR slightly refactors the newly added `ExprValue` API by quite a bit. The following

svn commit: r26289 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_08_02-653fe02-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 15:19:47 2018 New Revision: 26289 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_08_02-653fe02 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22941][CORE] Do not exit JVM when submit fails with in-process launcher.

2018-04-11 Thread irashid
Repository: spark Updated Branches: refs/heads/master 653fe0241 -> 3cb82047f [SPARK-22941][CORE] Do not exit JVM when submit fails with in-process launcher. The current in-process launcher implementation just calls the SparkSubmit object, which, in case of errors, will more often than not

svn commit: r26292 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_12_01-75a1830-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 19:15:50 2018 New Revision: 26292 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_12_01-75a1830 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 3cb82047f -> 75a183071 [SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M ## What changes were proposed in this pull request? Adds structured streaming tests using testTransformer for these suites: * IDF * Imputer *

spark git commit: [SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.3 320269e49 -> acfc156df [SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M This backports https://github.com/apache/spark/pull/20964 to branch-2.3. ## What changes were proposed in this pull request? Adds

svn commit: r26296 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_16_01-9d960de-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 23:15:43 2018 New Revision: 26296 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_16_01-9d960de docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: typo rawPredicition changed to rawPrediction

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.3 acfc156df -> 03a4dfd69 typo rawPredicition changed to rawPrediction MultilayerPerceptronClassifier had 4 occurrences ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this

spark git commit: typo rawPredicition changed to rawPrediction

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 75a183071 -> 9d960de08 typo rawPredicition changed to rawPrediction MultilayerPerceptronClassifier had 4 occurrences ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch

svn commit: r26294 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_14_01-acfc156-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 21:17:37 2018 New Revision: 26294 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_14_01-acfc156 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: Revert "[SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient"

2018-04-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9d960de08 -> e904dfaf0 Revert "[SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient" This reverts commit 271c891b91917d660d1f6b995de397c47c7a6058. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

svn commit: r26299 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_18_01-03a4dfd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Thu Apr 12 01:16:08 2018 New Revision: 26299 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_18_01-03a4dfd docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26300 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_20_01-e904dfa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Thu Apr 12 03:16:33 2018 New Revision: 26300 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_20_01-e904dfa docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]