svn commit: r27891 - in /dev/spark/2.3.2-SNAPSHOT-2018_07_02_22_01-bc7ee75-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Tue Jul 3 05:15:55 2018 New Revision: 27891 Log: Apache Spark 2.3.2-SNAPSHOT-2018_07_02_22_01-bc7ee75 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24385][SQL] Resolve self-join condition ambiguity for EqualNullSafe

2018-07-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 1cba0505e -> bc7ee7586 [SPARK-24385][SQL] Resolve self-join condition ambiguity for EqualNullSafe ## What changes were proposed in this pull request? In Dataset.join we have a small hack for resolving ambiguity in the column name for

spark git commit: [SPARK-24385][SQL] Resolve self-join condition ambiguity for EqualNullSafe

2018-07-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 85fe1297e -> a7c8f0c8c [SPARK-24385][SQL] Resolve self-join condition ambiguity for EqualNullSafe ## What changes were proposed in this pull request? In Dataset.join we have a small hack for resolving ambiguity in the column name for self

svn commit: r27887 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_02_16_01-85fe129-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Mon Jul 2 23:16:06 2018 New Revision: 27887 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_02_16_01-85fe129 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24428][K8S] Fix unused code

2018-07-02 Thread foxish
Repository: spark Updated Branches: refs/heads/master 42815548c -> 85fe1297e [SPARK-24428][K8S] Fix unused code ## What changes were proposed in this pull request? Remove code that is misleading and is a leftover from a previous implementation. ## How was this patch tested? Manually. Author

svn commit: r27873 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_02_12_01-4281554-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Mon Jul 2 19:16:09 2018 New Revision: 27873 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_02_12_01-4281554 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24683][K8S] Fix k8s no resource

2018-07-02 Thread mcheah
Repository: spark Updated Branches: refs/heads/master f599cde69 -> 42815548c [SPARK-24683][K8S] Fix k8s no resource ## What changes were proposed in this pull request? Make SparkSubmit pass in the main class even if `SparkLauncher.NO_RESOURCE` is the primary resource. ## How was this patch

svn commit: r27870 - in /dev/spark/2.3.2-SNAPSHOT-2018_07_02_10_01-1cba050-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Mon Jul 2 17:16:29 2018 New Revision: 27870 Log: Apache Spark 2.3.2-SNAPSHOT-2018_07_02_10_01-1cba050 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27859 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_02_08_01-f599cde-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Mon Jul 2 15:16:20 2018 New Revision: 27859 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_02_08_01-f599cde docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24507][DOCUMENTATION] Update streaming guide

2018-07-02 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 3c0af793f -> 1cba0505e [SPARK-24507][DOCUMENTATION] Update streaming guide ## What changes were proposed in this pull request? Updated streaming guide for direct stream and link to integration guide. ## How was this patch tested? jekyl

spark git commit: [SPARK-24507][DOCUMENTATION] Update streaming guide

2018-07-02 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8008f9cb8 -> f599cde69 [SPARK-24507][DOCUMENTATION] Update streaming guide ## What changes were proposed in this pull request? Updated streaming guide for direct stream and link to integration guide. ## How was this patch tested? jekyll bu

spark git commit: [SPARK-24715][BUILD] Override jline version as 2.14.3 in SBT

2018-07-02 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8f91c697e -> 8008f9cb8 [SPARK-24715][BUILD] Override jline version as 2.14.3 in SBT ## What changes were proposed in this pull request? During SPARK-24418 (Upgrade Scala to 2.11.12 and 2.12.6), we upgrade `jline` version together. So, `mv

svn commit: r27854 - /dev/spark/KEYS

2018-07-02 Thread jshao
Author: jshao Date: Mon Jul 2 12:18:41 2018 New Revision: 27854 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Mon Jul 2 12:18:41 2018 @@ -646

svn commit: r27847 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_02_00_01-8f91c69-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-02 Thread pwendell
Author: pwendell Date: Mon Jul 2 07:17:44 2018 New Revision: 27847 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_02_00_01-8f91c69 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---