spark git commit: [SPARK-23847][FOLLOWUP][PYTHON][SQL] Actually test [desc|acs]_nulls_[first|last] functions in PySpark

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 7c7570d46 -> c7622befd [SPARK-23847][FOLLOWUP][PYTHON][SQL] Actually test [desc|acs]_nulls_[first|last] functions in PySpark ## What changes were proposed in this pull request? There was a mistake in `tests.py` missing `assertEquals`. ##

spark git commit: [MINOR][DOCS] Fix R documentation generation instruction for roxygen2

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master c7622befd -> 87611bba2 [MINOR][DOCS] Fix R documentation generation instruction for roxygen2 ## What changes were proposed in this pull request? This PR proposes to fix `roxygen2` to `5.0.1` in `docs/README.md` for SparkR documentation ge

spark git commit: [MINOR][DOCS] Fix R documentation generation instruction for roxygen2

2018-04-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 0f2aabc6b -> 320269e49 [MINOR][DOCS] Fix R documentation generation instruction for roxygen2 ## What changes were proposed in this pull request? This PR proposes to fix `roxygen2` to `5.0.1` in `docs/README.md` for SparkR documentatio

spark git commit: [SPARK-23951][SQL] Use actual java class instead of string representation.

2018-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 87611bba2 -> c604d659e [SPARK-23951][SQL] Use actual java class instead of string representation. ## What changes were proposed in this pull request? This PR slightly refactors the newly added `ExprValue` API by quite a bit. The following

svn commit: r26288 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_06_01-320269e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 13:16:09 2018 New Revision: 26288 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_06_01-320269e docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient

2018-04-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c604d659e -> 271c891b9 [SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient ## What changes were proposed in this pull request? Mark `HashAggregateExec.bufVars` as transient to avoid it from being serialized. Also manually

spark git commit: [SPARK-6951][CORE] Speed up parsing of event logs during listing.

2018-04-11 Thread irashid
Repository: spark Updated Branches: refs/heads/master 271c891b9 -> 653fe0241 [SPARK-6951][CORE] Speed up parsing of event logs during listing. This change introduces two optimizations to help speed up generation of listing data when parsing events logs. The first one allows the parser to be s

spark git commit: [SPARK-22941][CORE] Do not exit JVM when submit fails with in-process launcher.

2018-04-11 Thread irashid
Repository: spark Updated Branches: refs/heads/master 653fe0241 -> 3cb82047f [SPARK-22941][CORE] Do not exit JVM when submit fails with in-process launcher. The current in-process launcher implementation just calls the SparkSubmit object, which, in case of errors, will more often than not exit

svn commit: r26289 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_08_02-653fe02-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 15:19:47 2018 New Revision: 26289 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_08_02-653fe02 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 3cb82047f -> 75a183071 [SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M ## What changes were proposed in this pull request? Adds structured streaming tests using testTransformer for these suites: * IDF * Imputer * Inter

spark git commit: [SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.3 320269e49 -> acfc156df [SPARK-22883][ML] ML test for StructuredStreaming: spark.ml.feature, I-M This backports https://github.com/apache/spark/pull/20964 to branch-2.3. ## What changes were proposed in this pull request? Adds structur

svn commit: r26292 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_12_01-75a1830-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 19:15:50 2018 New Revision: 26292 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_12_01-75a1830 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26294 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_14_01-acfc156-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 21:17:37 2018 New Revision: 26294 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_14_01-acfc156 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: typo rawPredicition changed to rawPrediction

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.3 acfc156df -> 03a4dfd69 typo rawPredicition changed to rawPrediction MultilayerPerceptronClassifier had 4 occurrences ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this pa

spark git commit: typo rawPredicition changed to rawPrediction

2018-04-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 75a183071 -> 9d960de08 typo rawPredicition changed to rawPrediction MultilayerPerceptronClassifier had 4 occurrences ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch

svn commit: r26296 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_16_01-9d960de-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Wed Apr 11 23:15:43 2018 New Revision: 26296 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_16_01-9d960de docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: Revert "[SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient"

2018-04-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9d960de08 -> e904dfaf0 Revert "[SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient" This reverts commit 271c891b91917d660d1f6b995de397c47c7a6058. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://

svn commit: r26299 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_11_18_01-03a4dfd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Thu Apr 12 01:16:08 2018 New Revision: 26299 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_11_18_01-03a4dfd docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26300 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_11_20_01-e904dfa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-11 Thread pwendell
Author: pwendell Date: Thu Apr 12 03:16:33 2018 New Revision: 26300 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_11_20_01-e904dfa docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---