svn commit: r29591 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_21_16_02-40edab2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 23:17:01 2018 New Revision: 29591 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_21_16_02-40edab2 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29590 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_21_14_02-1303eb5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 21:16:46 2018 New Revision: 29590 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_21_14_02-1303eb5 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25321][ML] Fix local LDA model constructor

2018-09-21 Thread meng
Repository: spark Updated Branches: refs/heads/branch-2.4 138a63165 -> 1303eb5c8 [SPARK-25321][ML] Fix local LDA model constructor ## What changes were proposed in this pull request? change back the constructor to: ``` class LocalLDAModel private[ml] ( uid: String, vocabSize: Int,

spark git commit: [SPARK-25321][ML] Fix local LDA model constructor

2018-09-21 Thread meng
Repository: spark Updated Branches: refs/heads/master 4a1120953 -> 40edab209 [SPARK-25321][ML] Fix local LDA model constructor ## What changes were proposed in this pull request? change back the constructor to: ``` class LocalLDAModel private[ml] ( uid: String, vocabSize: Int,

spark git commit: [SPARK-25321][ML] Revert SPARK-14681 to avoid API breaking change

2018-09-21 Thread meng
Repository: spark Updated Branches: refs/heads/branch-2.4 ce6636112 -> 138a63165 [SPARK-25321][ML] Revert SPARK-14681 to avoid API breaking change ## What changes were proposed in this pull request? Revert SPARK-14681 to avoid API breaking change. PR [SPARK-14681] will break mleap. ## How

svn commit: r29588 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_21_12_02-4a11209-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 19:17:24 2018 New Revision: 29588 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_21_12_02-4a11209 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29584 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_21_10_02-ce66361-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 17:17:07 2018 New Revision: 29584 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_21_10_02-ce66361 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-19724][SQL] allowCreatingManagedTableUsingNonemptyLocation should have legacy prefix

2018-09-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 604828eda -> ce6636112 [SPARK-19724][SQL] allowCreatingManagedTableUsingNonemptyLocation should have legacy prefix One more legacy config to go ... Closes #22515 from rxin/allowCreatingManagedTableUsingNonemptyLocation. Authored-by:

spark git commit: [SPARK-19724][SQL] allowCreatingManagedTableUsingNonemptyLocation should have legacy prefix

2018-09-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master d25f425c9 -> 4a1120953 [SPARK-19724][SQL] allowCreatingManagedTableUsingNonemptyLocation should have legacy prefix One more legacy config to go ... Closes #22515 from rxin/allowCreatingManagedTableUsingNonemptyLocation. Authored-by:

spark git commit: [SPARK-25499][TEST] Refactor BenchmarkBase and Benchmark

2018-09-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ff601cf71 -> d25f425c9 [SPARK-25499][TEST] Refactor BenchmarkBase and Benchmark ## What changes were proposed in this pull request? Currently there are two classes with the same naming BenchmarkBase: 1.

spark git commit: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests.

2018-09-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 2c9d8f56c -> ff601cf71 [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests. ## What changes were proposed in this pull request? Description: Right now, the default server side netty handler

svn commit: r29578 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_21_06_02-604828e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 13:16:55 2018 New Revision: 29578 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_21_06_02-604828e docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29573 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_21_04_02-2c9d8f5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 11:17:08 2018 New Revision: 29573 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_21_04_02-2c9d8f5 docs [This commit notification would consist of 1486 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25469][SQL] Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-21 Thread yamamuro
Repository: spark Updated Branches: refs/heads/branch-2.4 e42546259 -> 604828eda [SPARK-25469][SQL] Eval methods of Concat, Reverse and ElementAt should use pattern matching only once ## What changes were proposed in this pull request? The PR proposes to avoid usage of pattern matching for

spark git commit: [SPARK-25469][SQL] Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-21 Thread yamamuro
Repository: spark Updated Branches: refs/heads/master 411ecc365 -> 2c9d8f56c [SPARK-25469][SQL] Eval methods of Concat, Reverse and ElementAt should use pattern matching only once ## What changes were proposed in this pull request? The PR proposes to avoid usage of pattern matching for each

svn commit: r29572 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_21_02_02-e425462-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 09:17:02 2018 New Revision: 29572 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_21_02_02-e425462 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29567 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_21_00_02-411ecc3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-21 Thread pwendell
Author: pwendell Date: Fri Sep 21 07:17:51 2018 New Revision: 29567 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_21_00_02-411ecc3 docs [This commit notification would consist of 1486 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23549][SQL] Rename config spark.sql.legacy.compareDateTimestampInTimestamp

2018-09-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 aff6aedf9 -> e42546259 [SPARK-23549][SQL] Rename config spark.sql.legacy.compareDateTimestampInTimestamp ## What changes were proposed in this pull request? See title. Makes our legacy backward compatibility configs more consistent.

spark git commit: [SPARK-23549][SQL] Rename config spark.sql.legacy.compareDateTimestampInTimestamp

2018-09-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fb3276a54 -> 411ecc365 [SPARK-23549][SQL] Rename config spark.sql.legacy.compareDateTimestampInTimestamp ## What changes were proposed in this pull request? See title. Makes our legacy backward compatibility configs more consistent. ##

spark git commit: [SPARK-25384][SQL] Clarify fromJsonForceNullableSchema will be removed in Spark 3.0

2018-09-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 5d7444996 -> aff6aedf9 [SPARK-25384][SQL] Clarify fromJsonForceNullableSchema will be removed in Spark 3.0 See above. This should go into the 2.4 release. Closes #22509 from rxin/SPARK-25384. Authored-by: Reynold Xin Signed-off-by:

spark git commit: [SPARK-25384][SQL] Clarify fromJsonForceNullableSchema will be removed in Spark 3.0

2018-09-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 1f4ca6f5c -> fb3276a54 [SPARK-25384][SQL] Clarify fromJsonForceNullableSchema will be removed in Spark 3.0 See above. This should go into the 2.4 release. Closes #22509 from rxin/SPARK-25384. Authored-by: Reynold Xin Signed-off-by:

spark git commit: [SPARK-25487][SQL][TEST] Refactor PrimitiveArrayBenchmark

2018-09-21 Thread kiszk
Repository: spark Updated Branches: refs/heads/master 596af211a -> 1f4ca6f5c [SPARK-25487][SQL][TEST] Refactor PrimitiveArrayBenchmark ## What changes were proposed in this pull request? Refactor PrimitiveArrayBenchmark to use main method and print the output as a separate file. Run blow