svn commit: r27209 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_00_01-98909c3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 07:16:46 2018 New Revision: 27209 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_00_01-98909c3 docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27210 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_01_02_01-e56266a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 09:16:28 2018 New Revision: 27210 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_01_02_01-e56266a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24351][SS] offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode

2018-06-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 98909c398 -> 6039b1323 [SPARK-24351][SS] offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode ## What changes were proposed in this pull request? Compute the threshold

[2/2] spark git commit: Preparing development version 2.3.2-SNAPSHOT

2018-06-01 Thread vanzin
Preparing development version 2.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2e0c3469 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2e0c3469 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2e0

[spark] Git Push Summary

2018-06-01 Thread vanzin
Repository: spark Updated Tags: refs/tags/v2.3.1-rc3 [created] 1cc5f68be - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.3.1-rc3

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 e56266ad7 -> 2e0c3469d Preparing Spark release v2.3.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1cc5f68b Tree: http://git-wip-us.apache.org/repos/asf/spar

svn commit: r27213 - /dev/spark/v2.3.1-rc3-bin/

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 18:19:42 2018 New Revision: 27213 Log: Apache Spark v2.3.1-rc3 Added: dev/spark/v2.3.1-rc3-bin/ dev/spark/v2.3.1-rc3-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc3-bin/SparkR_2.3.1.tar.gz.asc dev/spark/v2.3.1-rc3-bin/SparkR_2.3.1.tar.gz

svn commit: r27214 - in /dev/spark/v2.3.1-rc3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 18:32:25 2018 New Revision: 27214 Log: Apache Spark v2.3.1-rc3 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] --

spark git commit: Revert "[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set"

2018-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 6039b1323 -> d2c3de7ef Revert "[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set" This reverts commit 1e46f92f956a00d04d47340489b6125d44dbd47b. Project: http://git-wip-us.apache.org/repos

spark git commit: Revert "[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set"

2018-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 2e0c3469d -> e4e96f929 Revert "[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set" This reverts commit 66289a3e067769cb8ed35953187f6363463791e1. Project: http://git-wip-us.apache.org/r

spark git commit: [INFRA] Close stale PRs.

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master d2c3de7ef -> 09e78c1ea [INFRA] Close stale PRs. Closes #21444 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/09e78c1e Tree: http://git-wip-us.apache.org/repos/asf/spa

svn commit: r27216 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_12_01-09e78c1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 19:16:14 2018 New Revision: 27216 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_12_01-09e78c1 docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[1/2] spark git commit: Preparing Spark release v2.3.1-rc4

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 e4e96f929 -> 21800b878 Preparing Spark release v2.3.1-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30aaa5a3 Tree: http://git-wip-us.apache.org/repos/asf/spar

[spark] Git Push Summary

2018-06-01 Thread vanzin
Repository: spark Updated Tags: refs/tags/v2.3.1-rc4 [created] 30aaa5a3a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.3.2-SNAPSHOT

2018-06-01 Thread vanzin
Preparing development version 2.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21800b87 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/21800b87 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/218

spark git commit: [SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a Standalone cluster

2018-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 09e78c1ea -> 8ef167a5f [SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a Standalone cluster ## What changes were proposed in this pull request? Currently we only clean up the local directories

svn commit: r27219 - /dev/spark/v2.3.1-rc4-bin/

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 20:59:55 2018 New Revision: 27219 Log: Apache Spark v2.3.1-rc4 Added: dev/spark/v2.3.1-rc4-bin/ dev/spark/v2.3.1-rc4-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc4-bin/SparkR_2.3.1.tar.gz.asc dev/spark/v2.3.1-rc4-bin/SparkR_2.3.1.tar.gz

svn commit: r27220 - in /dev/spark/v2.3.1-rc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 21:12:21 2018 New Revision: 27220 Log: Apache Spark v2.3.1-rc4 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] --

svn commit: r27221 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_01_14_01-21800b8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 21:16:28 2018 New Revision: 27221 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_01_14_01-21800b8 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27222 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_16_01-8ef167a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 23:16:03 2018 New Revision: 27222 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_16_01-8ef167a docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23668][K8S] Added missing config property in running-on-kubernetes.md

2018-06-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 8ef167a5f -> a36c1a6bb [SPARK-23668][K8S] Added missing config property in running-on-kubernetes.md ## What changes were proposed in this pull request? PR https://github.com/apache/spark/pull/20811 introduced a new Spark configuration prop