svn commit: r29775 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_28_22_02-ec2c17a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Sat Sep 29 05:19:01 2018 New Revision: 29775 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_28_22_02-ec2c17a docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29774 - in /dev/spark/2.3.3-SNAPSHOT-2018_09_28_22_02-eb78380-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Sat Sep 29 05:17:19 2018 New Revision: 29774 Log: Apache Spark 2.3.3-SNAPSHOT-2018_09_28_22_02-eb78380 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

2018-09-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 f13565b6e -> eb78380c0 [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite ## What changes were proposed in this pull request? This PR aims to prevent test slowdowns at

spark git commit: [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

2018-09-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 7614313c9 -> ec2c17abf [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite ## What changes were proposed in this pull request? This PR aims to prevent test slowdowns at

spark git commit: [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite

2018-09-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master e99ba8d7c -> 1e437835e [SPARK-25570][SQL][TEST] Replace 2.3.1 with 2.3.2 in HiveExternalCatalogVersionsSuite ## What changes were proposed in this pull request? This PR aims to prevent test slowdowns at `HiveExternalCatalogVersionsSuite`

spark git commit: [SPARK-25262][DOC][FOLLOWUP] Fix missing markup tag

2018-09-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 5d726b865 -> e99ba8d7c [SPARK-25262][DOC][FOLLOWUP] Fix missing markup tag ## What changes were proposed in this pull request? This adds a missing end markup tag. This should go `master` branch only. ## How was this patch tested? This

svn commit: r29772 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_28_20_02-5d726b8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Sat Sep 29 03:17:05 2018 New Revision: 29772 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_28_20_02-5d726b8 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29771 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_28_18_02-7614313-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Sat Sep 29 01:16:37 2018 New Revision: 29771 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_28_18_02-7614313 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25559][SQL] Remove the unsupported predicates in Parquet when possible

2018-09-28 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 9362c5cc2 -> 5d726b865 [SPARK-25559][SQL] Remove the unsupported predicates in Parquet when possible ## What changes were proposed in this pull request? Currently, in `ParquetFilters`, if one of the children predicates is not supported

spark git commit: [SPARK-25449][CORE] Heartbeat shouldn't include accumulators for zero metrics

2018-09-28 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master a28146568 -> 9362c5cc2 [SPARK-25449][CORE] Heartbeat shouldn't include accumulators for zero metrics ## What changes were proposed in this pull request? Heartbeat shouldn't include accumulators for zero metrics. Heartbeats sent from

svn commit: r29770 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_28_16_02-a281465-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Fri Sep 28 23:17:21 2018 New Revision: 29770 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_28_16_02-a281465 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25429][SQL] Use Set instead of Array to improve lookup performance

2018-09-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7deef7a49 -> a28146568 [SPARK-25429][SQL] Use Set instead of Array to improve lookup performance ## What changes were proposed in this pull request? Use `Set` instead of `Array` to improve `accumulatorIds.contains(acc.id)` performance.

spark git commit: [SPARK-25458][SQL] Support FOR ALL COLUMNS in ANALYZE TABLE

2018-09-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b7d80349b -> 7deef7a49 [SPARK-25458][SQL] Support FOR ALL COLUMNS in ANALYZE TABLE ## What changes were proposed in this pull request? **Description from the JIRA :** Currently, to collect the statistics of all the columns, users need to

spark git commit: [SPARK-25542][CORE][TEST] Move flaky test in OpenHashMapSuite to OpenHashSetSuite and make it against OpenHashSet

2018-09-28 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 81391c274 -> 7614313c9 [SPARK-25542][CORE][TEST] Move flaky test in OpenHashMapSuite to OpenHashSetSuite and make it against OpenHashSet ## What changes were proposed in this pull request? The specified test in OpenHashMapSuite to

spark git commit: [SPARK-25542][CORE][TEST] Move flaky test in OpenHashMapSuite to OpenHashSetSuite and make it against OpenHashSet

2018-09-28 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 0b33f0868 -> b7d80349b [SPARK-25542][CORE][TEST] Move flaky test in OpenHashMapSuite to OpenHashSetSuite and make it against OpenHashSet ## What changes were proposed in this pull request? The specified test in OpenHashMapSuite to test

spark git commit: [SPARK-23285][DOC][FOLLOWUP] Fix missing markup tag

2018-09-28 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 b2a1e2f8d -> 81391c274 [SPARK-23285][DOC][FOLLOWUP] Fix missing markup tag ## What changes were proposed in this pull request? This adds a missing markup tag. This should go to `master/branch-2.4`. ## How was this patch tested?

spark git commit: [SPARK-23285][DOC][FOLLOWUP] Fix missing markup tag

2018-09-28 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master e120a38c0 -> 0b33f0868 [SPARK-23285][DOC][FOLLOWUP] Fix missing markup tag ## What changes were proposed in this pull request? This adds a missing markup tag. This should go to `master/branch-2.4`. ## How was this patch tested? Manual

svn commit: r29762 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_28_04_02-e120a38-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Fri Sep 28 11:17:10 2018 New Revision: 29762 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_28_04_02-e120a38 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29759 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_28_02_03-b2a1e2f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-28 Thread pwendell
Author: pwendell Date: Fri Sep 28 09:17:41 2018 New Revision: 29759 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_28_02_03-b2a1e2f docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25505][SQL] The output order of grouping columns in Pivot is different from the input order

2018-09-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 a43a082e0 -> b2a1e2f8d [SPARK-25505][SQL] The output order of grouping columns in Pivot is different from the input order ## What changes were proposed in this pull request? The grouping columns from a Pivot query are inferred as

spark git commit: [SPARK-25505][SQL] The output order of grouping columns in Pivot is different from the input order

2018-09-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3b7395fe0 -> e120a38c0 [SPARK-25505][SQL] The output order of grouping columns in Pivot is different from the input order ## What changes were proposed in this pull request? The grouping columns from a Pivot query are inferred as "input