svn commit: r26334 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_13_20_01-73f2853-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Apr 14 03:15:33 2018 New Revision: 26334 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_13_20_01-73f2853 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23979][SQL] MultiAlias should not be a CodegenFallback

Repository: spark Updated Branches: refs/heads/master cbb41a0c5 -> 73f28530d [SPARK-23979][SQL] MultiAlias should not be a CodegenFallback ## What changes were proposed in this pull request? Just found `MultiAlias` is a `CodegenFallback`. It should not be as looks like `MultiAlias` won't be

spark git commit: [SPARK-23966][SS] Refactoring all checkpoint file writing logic in a common CheckpointFileManager interface

Repository: spark Updated Branches: refs/heads/master 558f31b31 -> cbb41a0c5 [SPARK-23966][SS] Refactoring all checkpoint file writing logic in a common CheckpointFileManager interface ## What changes were proposed in this pull request? Checkpoint files (offset log files, state store files)

svn commit: r26333 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_13_16_01-558f31b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Apr 13 23:15:51 2018 New Revision: 26333 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_13_16_01-558f31b docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table

Repository: spark Updated Branches: refs/heads/master 25892f3cc -> 558f31b31 [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table ## What changes were proposed in this pull request? TableReader would get disproportionately slower as the number of

spark-website git commit: Update committer page

Repository: spark-website Updated Branches: refs/heads/asf-site 658467248 -> 69b595481 Update committer page Author: DB Tsai Closes #113 from dbtsai/changeAffiliation. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit:

svn commit: r26330 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_13_12_01-25892f3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Apr 13 19:16:00 2018 New Revision: 26330 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_13_12_01-25892f3 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

Repository: spark Updated Branches: refs/heads/master 4dfd746de -> 25892f3cc [SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer ## What changes were proposed in this pull request? Added a new rule to remove Sort operation when its child is already sorted. For instance, this simple code:

spark git commit: [SPARK-23896][SQL] Improve PartitioningAwareFileIndex

Repository: spark Updated Branches: refs/heads/master a83ae0d9b -> 4dfd746de [SPARK-23896][SQL] Improve PartitioningAwareFileIndex ## What changes were proposed in this pull request? Currently `PartitioningAwareFileIndex` accepts an optional parameter `userPartitionSchema`. If provided, it

[1/3] spark git commit: [SPARK-22839][K8S] Refactor to unify driver and executor pod builder APIs

Repository: spark Updated Branches: refs/heads/master 0323e6146 -> a83ae0d9b http://git-wip-us.apache.org/repos/asf/spark/blob/a83ae0d9/resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/MountSecretsFeatureStepSuite.scala

[2/3] spark git commit: [SPARK-22839][K8S] Refactor to unify driver and executor pod builder APIs

http://git-wip-us.apache.org/repos/asf/spark/blob/a83ae0d9/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DependencyResolutionStep.scala -- diff --git

[3/3] spark git commit: [SPARK-22839][K8S] Refactor to unify driver and executor pod builder APIs

[SPARK-22839][K8S] Refactor to unify driver and executor pod builder APIs ## What changes were proposed in this pull request? Breaks down the construction of driver pods and executor pods in a way that uses a common abstraction for both spark-submit creating the driver and

svn commit: r26320 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_13_02_01-dfdf1bb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Apr 13 09:15:58 2018 New Revision: 26320 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_13_02_01-dfdf1bb docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26319 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_13_00_01-0323e61-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Apr 13 07:17:57 2018 New Revision: 26319 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_13_00_01-0323e61 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23905][SQL] Add UDF weekday

Repository: spark Updated Branches: refs/heads/master 4b0703679 -> 0323e6146 [SPARK-23905][SQL] Add UDF weekday ## What changes were proposed in this pull request? Add UDF weekday ## How was this patch tested? A new test Author: yucai Closes #21009 from yucai/SPARK-23905.