svn commit: r29467 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_18_00_02-ba838fe-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 07:17:01 2018 New Revision: 29467 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_18_00_02-ba838fe docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24151][SQL] Case insensitive resolution of CURRENT_DATE and CURRENT_TIMESTAMP

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 c40375190 -> ffd448bb0 [SPARK-24151][SQL] Case insensitive resolution of CURRENT_DATE and CURRENT_TIMESTAMP ## What changes were proposed in this pull request? SPARK-22333 introduced a regression in the resolution of `CURRENT_DATE`

spark git commit: [SPARK-24151][SQL] Case insensitive resolution of CURRENT_DATE and CURRENT_TIMESTAMP

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master acc645257 -> ba838fee0 [SPARK-24151][SQL] Case insensitive resolution of CURRENT_DATE and CURRENT_TIMESTAMP ## What changes were proposed in this pull request? SPARK-22333 introduced a regression in the resolution of `CURRENT_DATE` and

spark git commit: [SPARK-25291][K8S] Fixing Flakiness of Executor Pod tests

2018-09-18 Thread liyinan926
Repository: spark Updated Branches: refs/heads/branch-2.4 8a2992ed4 -> 67f2cb6e0 [SPARK-25291][K8S] Fixing Flakiness of Executor Pod tests ## What changes were proposed in this pull request? Added fix to flakiness that was present in PySpark tests w.r.t Executors not being tested.

spark git commit: [SPARK-25291][K8S] Fixing Flakiness of Executor Pod tests

2018-09-18 Thread liyinan926
Repository: spark Updated Branches: refs/heads/master 182da81e9 -> 123f0041d [SPARK-25291][K8S] Fixing Flakiness of Executor Pod tests ## What changes were proposed in this pull request? Added fix to flakiness that was present in PySpark tests w.r.t Executors not being tested. Important

svn commit: r29498 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_18_12_03-123f004-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 19:17:38 2018 New Revision: 29498 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_18_12_03-123f004 docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-19550][DOC][FOLLOW-UP] Update tuning.md to use JDK8

2018-09-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1c0423b28 -> 182da81e9 [SPARK-19550][DOC][FOLLOW-UP] Update tuning.md to use JDK8 ## What changes were proposed in this pull request? Update `tuning.md` and `rdd-programming-guide.md` to use JDK8. ## How was this patch tested? manual

spark git commit: [SPARK-19550][DOC][FOLLOW-UP] Update tuning.md to use JDK8

2018-09-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 cc3fbea8b -> 8a2992ed4 [SPARK-19550][DOC][FOLLOW-UP] Update tuning.md to use JDK8 ## What changes were proposed in this pull request? Update `tuning.md` and `rdd-programming-guide.md` to use JDK8. ## How was this patch tested?

svn commit: r29487 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_18_08_02-1c0423b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 15:17:06 2018 New Revision: 29487 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_18_08_02-1c0423b docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29493 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_18_10_02-8a2992e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 17:17:16 2018 New Revision: 29493 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_18_10_02-8a2992e docs [This commit notification would consist of 1475 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29500 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_18_14_02-67f2cb6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 21:16:56 2018 New Revision: 29500 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_18_14_02-67f2cb6 docs [This commit notification would consist of 1475 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25456][SQL][TEST] Fix PythonForeachWriterSuite

2018-09-18 Thread irashid
Repository: spark Updated Branches: refs/heads/master 123f0041d -> a6f37b074 [SPARK-25456][SQL][TEST] Fix PythonForeachWriterSuite PythonForeachWriterSuite was failing because RowQueue now needs to have a handle on a SparkEnv with a SerializerManager, so added a mock env with a serializer

svn commit: r29502 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_18_16_03-a6f37b0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Tue Sep 18 23:17:17 2018 New Revision: 29502 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_18_16_03-a6f37b0 docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25456][SQL][TEST] Fix PythonForeachWriterSuite

2018-09-18 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.4 67f2cb6e0 -> 76514a015 [SPARK-25456][SQL][TEST] Fix PythonForeachWriterSuite PythonForeachWriterSuite was failing because RowQueue now needs to have a handle on a SparkEnv with a SerializerManager, so added a mock env with a

svn commit: r29503 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_18_18_02-76514a0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-18 Thread pwendell
Author: pwendell Date: Wed Sep 19 01:16:41 2018 New Revision: 29503 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_18_18_02-76514a0 docs [This commit notification would consist of 1475 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23200] Reset Kubernetes-specific config on Checkpoint restore

2018-09-18 Thread liyinan926
Repository: spark Updated Branches: refs/heads/master a6f37b074 -> 497f00f62 [SPARK-23200] Reset Kubernetes-specific config on Checkpoint restore Several configuration parameters related to Kubernetes need to be reset, as they are changed with each invokation of spark-submit and thus prevents

spark git commit: [SPARK-23200] Reset Kubernetes-specific config on Checkpoint restore

2018-09-18 Thread liyinan926
Repository: spark Updated Branches: refs/heads/branch-2.4 76514a015 -> ba8560a96 [SPARK-23200] Reset Kubernetes-specific config on Checkpoint restore Several configuration parameters related to Kubernetes need to be reset, as they are changed with each invokation of spark-submit and thus

spark-website git commit: Add Kazuaki Ishizaki to the list of committers

2018-09-18 Thread kiszk
Repository: spark-website Updated Branches: refs/heads/asf-site 370d99580 -> 9b21d71d2 Add Kazuaki Ishizaki to the list of committers Author: Kazuaki Ishizaki Closes #147 from kiszk/addCommitter. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit:

spark git commit: [SPARK-24626] Add statistics prefix to parallelFileListingInStatsComputation

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 00ede120e -> f11f44548 [SPARK-24626] Add statistics prefix to parallelFileListingInStatsComputation ## What changes were proposed in this pull request? To be more consistent with other statistics based configs. ## How was this patch

spark git commit: [SPARK-24626] Add statistics prefix to parallelFileListingInStatsComputation

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 6c7db7fd1 -> 4193c7623 [SPARK-24626] Add statistics prefix to parallelFileListingInStatsComputation ## What changes were proposed in this pull request? To be more consistent with other statistics based configs. ## How was this patch

spark git commit: [SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 497f00f62 -> 6c7db7fd1 [SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema ## What changes were proposed in this pull request? `spark.sql.fromJsonForceNullableSchema` -> `spark.sql.function.fromJson.forceNullable` ## How was

spark git commit: [SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema

2018-09-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 ba8560a96 -> 00ede120e [SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema ## What changes were proposed in this pull request? `spark.sql.fromJsonForceNullableSchema` -> `spark.sql.function.fromJson.forceNullable` ## How

spark git commit: [SPARK-25445][BUILD] the release script should be able to publish a scala-2.12 build

2018-09-18 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 ffd448bb0 -> cc3fbea8b [SPARK-25445][BUILD] the release script should be able to publish a scala-2.12 build ## What changes were proposed in this pull request? update the package and publish steps, to support scala 2.12 ## How was

spark git commit: [SPARK-25445][BUILD] the release script should be able to publish a scala-2.12 build

2018-09-18 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ba838fee0 -> 1c0423b28 [SPARK-25445][BUILD] the release script should be able to publish a scala-2.12 build ## What changes were proposed in this pull request? update the package and publish steps, to support scala 2.12 ## How was this