spark git commit: [SPARK-26189][R] Fix unionAll doc in SparkR

2018-11-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 28d337440 -> 2f6e88fec [SPARK-26189][R] Fix unionAll doc in SparkR ## What changes were proposed in this pull request? Fix unionAll doc in SparkR ## How was this patch tested? Manually ran test Author: Huaxin Gao Closes #23161 from

svn commit: r31280 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_30_21_44-28d3374-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Sat Dec 1 05:56:51 2018 New Revision: 31280 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_30_21_44-28d3374 docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23647][PYTHON][SQL] Adds more types for hint in pyspark

2018-11-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6be272b75 -> 28d337440 [SPARK-23647][PYTHON][SQL] Adds more types for hint in pyspark Signed-off-by: DylanGuedes ## What changes were proposed in this pull request? Addition of float, int and list hints for `pyspark.sql` Hint. ## How

svn commit: r31279 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_30_17_40-6be272b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Sat Dec 1 01:52:30 2018 New Revision: 31279 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_30_17_40-6be272b docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[2/3] spark git commit: [SPARK-25876][K8S] Simplify kubernetes configuration types.

2018-11-30 Thread mcheah
http://git-wip-us.apache.org/repos/asf/spark/blob/6be272b7/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala -- diff --git

[1/3] spark git commit: [SPARK-25876][K8S] Simplify kubernetes configuration types.

2018-11-30 Thread mcheah
Repository: spark Updated Branches: refs/heads/master 8856e9f6a -> 6be272b75 http://git-wip-us.apache.org/repos/asf/spark/blob/6be272b7/resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilderSuite.scala

[3/3] spark git commit: [SPARK-25876][K8S] Simplify kubernetes configuration types.

2018-11-30 Thread mcheah
[SPARK-25876][K8S] Simplify kubernetes configuration types. There are a few issues with the current configuration types used in the kubernetes backend: - they use type parameters for role-specific specialization, which makes type signatures really noisy throughout the code base. - they break

spark git commit: [SPARK-26219][CORE] Executor summary should get updated for failure jobs in the history server UI

2018-11-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 36edbac1c -> 8856e9f6a [SPARK-26219][CORE] Executor summary should get updated for failure jobs in the history server UI The root cause of the problem is, whenever the taskEnd event comes after stageCompleted event, execSummary is

spark git commit: [SPARK-26226][SQL] Update query tracker to report timeline for phases

2018-11-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9b23be2e9 -> 36edbac1c [SPARK-26226][SQL] Update query tracker to report timeline for phases ## What changes were proposed in this pull request? This patch changes the query plan tracker added earlier to report phase timeline, rather than

svn commit: r31273 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_30_13_29-9b23be2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Fri Nov 30 21:42:23 2018 New Revision: 31273 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_30_13_29-9b23be2 docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31262 - in /dev/spark/2.4.1-SNAPSHOT-2018_11_30_11_24-b68decf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Fri Nov 30 19:40:39 2018 New Revision: 31262 Log: Apache Spark 2.4.1-SNAPSHOT-2018_11_30_11_24-b68decf docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31261 - in /dev/spark/2.3.3-SNAPSHOT-2018_11_30_11_23-4ee463a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Fri Nov 30 19:38:44 2018 New Revision: 31261 Log: Apache Spark 2.3.3-SNAPSHOT-2018_11_30_11_23-4ee463a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-26201] Fix python broadcast with encryption

2018-11-30 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.4 4661ac76a -> b68decf19 [SPARK-26201] Fix python broadcast with encryption ## What changes were proposed in this pull request? Python with rpc and disk encryption enabled along with a python broadcast variable and just read the value

spark git commit: [SPARK-26201] Fix python broadcast with encryption

2018-11-30 Thread tgraves
Repository: spark Updated Branches: refs/heads/master c3f27b243 -> 9b23be2e9 [SPARK-26201] Fix python broadcast with encryption ## What changes were proposed in this pull request? Python with rpc and disk encryption enabled along with a python broadcast variable and just read the value back

svn commit: r31257 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_30_09_17-c3f27b2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Fri Nov 30 17:29:15 2018 New Revision: 31257 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_30_09_17-c3f27b2 docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [MINOR][DOCS] Fix typos

2018-11-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2b2c94a3e -> c3f27b243 [MINOR][DOCS] Fix typos ## What changes were proposed in this pull request? Fix Typos. This PR is the complete version of https://github.com/apache/spark/pull/23145. ## How was this patch tested? NA Closes #23185

svn commit: r31238 - in /dev/spark/3.0.0-SNAPSHOT-2018_11_30_00_50-2b2c94a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-11-30 Thread pwendell
Author: pwendell Date: Fri Nov 30 09:02:24 2018 New Revision: 31238 Log: Apache Spark 3.0.0-SNAPSHOT-2018_11_30_00_50-2b2c94a docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[1/2] spark git commit: [SPARK-25528][SQL] data source v2 API refactor (batch read)

2018-11-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9cfc3ee62 -> 2b2c94a3e http://git-wip-us.apache.org/repos/asf/spark/blob/2b2c94a3/sql/core/src/test/java/test/org/apache/spark/sql/sources/v2/JavaSimpleBatchTable.java --

[2/2] spark git commit: [SPARK-25528][SQL] data source v2 API refactor (batch read)

2018-11-30 Thread lixiao
[SPARK-25528][SQL] data source v2 API refactor (batch read) ## What changes were proposed in this pull request? This is the first step of the data source v2 API refactor [proposal](https://docs.google.com/document/d/1uUmKCpWLdh9vHxP7AWJ9EgbwB_U6T3EJYNjhISGmiQg/edit?usp=sharing) It adds the new