spark git commit: [SPARK-22018][SQL] Preserve top-level alias metadata when collapsing projects

2017-09-14 Thread tdas
Repository: spark Updated Branches: refs/heads/master a28728a9a -> 88661747f [SPARK-22018][SQL] Preserve top-level alias metadata when collapsing projects ## What changes were proposed in this pull request? If there are two projects like as follows. ``` Project [a_with_metadata#27 AS b#26] +-

spark git commit: [SPARK-21513][SQL][FOLLOWUP] Allow UDF to_json support converting MapType to json for PySpark and SparkR

2017-09-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 054ddb2f5 -> a28728a9a [SPARK-21513][SQL][FOLLOWUP] Allow UDF to_json support converting MapType to json for PySpark and SparkR ## What changes were proposed in this pull request? In previous work SPARK-21513, we has allowed `MapType` and

spark git commit: [SPARK-21988] Add default stats to StreamingExecutionRelation.

2017-09-14 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master ddd7f5e11 -> 054ddb2f5 [SPARK-21988] Add default stats to StreamingExecutionRelation. ## What changes were proposed in this pull request? Add default stats to StreamingExecutionRelation. ## How was this patch tested? existing unit tests

spark git commit: [SPARK-17642][SQL][FOLLOWUP] drop test tables and improve comments

2017-09-14 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 4b88393cb -> ddd7f5e11 [SPARK-17642][SQL][FOLLOWUP] drop test tables and improve comments ## What changes were proposed in this pull request? Drop test tables and improve comments. ## How was this patch tested? Modified existing test.

spark git commit: [SPARK-21922] Fix duration always updating when task failed but status is still RUN…

2017-09-14 Thread jshao
Repository: spark Updated Branches: refs/heads/master 4e6fc6901 -> 4b88393cb [SPARK-21922] Fix duration always updating when task failed but status is still RUN… …NING ## What changes were proposed in this pull request? When driver quit abnormally which cause executor shutdown and task

Voice Message from 011304814234 - name unavailable

2017-09-14 Thread Voice Message
Time: Thu, 14 Sep 2017 14:29:37 +0500 From: 011304814234 - name unavailable Click to listen Voice Message

spark git commit: [SPARK-4131][FOLLOW-UP] Support "Writing data into the filesystem from queries"

2017-09-14 Thread wenchen
Repository: spark Updated Branches: refs/heads/master c76153cc7 -> 4e6fc6901 [SPARK-4131][FOLLOW-UP] Support "Writing data into the filesystem from queries" ## What changes were proposed in this pull request? This PR is clean the codes in https://github.com/apache/spark/pull/18975 ## How was

spark git commit: [SPARK-18608][ML][FOLLOWUP] Fix double caching for PySpark OneVsRest.

2017-09-14 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.2 3a692e355 -> 51e5a821d [SPARK-18608][ML][FOLLOWUP] Fix double caching for PySpark OneVsRest. ## What changes were proposed in this pull request? #19197 fixed double caching for MLlib algorithms, but missed PySpark ```OneVsRest```,

spark git commit: [SPARK-18608][ML][FOLLOWUP] Fix double caching for PySpark OneVsRest.

2017-09-14 Thread yliang
Repository: spark Updated Branches: refs/heads/master 66cb72d7b -> c76153cc7 [SPARK-18608][ML][FOLLOWUP] Fix double caching for PySpark OneVsRest. ## What changes were proposed in this pull request? #19197 fixed double caching for MLlib algorithms, but missed PySpark ```OneVsRest```, this PR

spark git commit: [MINOR][DOC] Add missing call of `update()` in examples of PeriodicGraphCheckpointer & PeriodicRDDCheckpointer

2017-09-14 Thread yliang
Repository: spark Updated Branches: refs/heads/master 8d8641f12 -> 66cb72d7b [MINOR][DOC] Add missing call of `update()` in examples of PeriodicGraphCheckpointer & PeriodicRDDCheckpointer ## What changes were proposed in this pull request? forgot to call `update()` with `graph1` & `rdd1` in