svn commit: r26580 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_27_20_01-ad94e85-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Sat Apr 28 03:15:20 2018 New Revision: 26580 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_27_20_01-ad94e85 docs [This commit notification would consist of 1460 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23736][SQL][FOLLOWUP] Error message should contains SQL types

2018-04-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 1fb46f30f -> ad94e8592 [SPARK-23736][SQL][FOLLOWUP] Error message should contains SQL types ## What changes were proposed in this pull request? In the error messages we should return the SQL types (like `string` rather than the internal t

spark git commit: [SPARK-23688][SS] Refactor tests away from rate source

2018-04-27 Thread jshao
Repository: spark Updated Branches: refs/heads/master 8614edd44 -> 1fb46f30f [SPARK-23688][SS] Refactor tests away from rate source ## What changes were proposed in this pull request? Replace rate source with memory source in continuous mode test suite. Keep using "rate" source if the tests

svn commit: r26579 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_27_18_01-df45ddb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Sat Apr 28 01:15:06 2018 New Revision: 26579 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_27_18_01-df45ddb docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26578 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_27_16_01-8614edd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Fri Apr 27 23:15:14 2018 New Revision: 26578 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_27_16_01-8614edd docs [This commit notification would consist of 1460 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26576 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_27_14_01-4a10df0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Fri Apr 27 21:15:20 2018 New Revision: 26576 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_27_14_01-4a10df0 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24104] SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them

2018-04-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 3fd297af6 -> 8614edd44 [SPARK-24104] SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them ## What changes were proposed in this pull request? Event `SparkListenerDriverAccumUpdates` may happen multiple tim

spark git commit: [SPARK-24104] SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them

2018-04-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 4a10df0f6 -> df45ddb9d [SPARK-24104] SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them ## What changes were proposed in this pull request? Event `SparkListenerDriverAccumUpdates` may happen multiple

svn commit: r26572 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_27_12_01-3fd297a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Fri Apr 27 19:15:40 2018 New Revision: 26572 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_27_12_01-3fd297a docs [This commit notification would consist of 1460 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24085][SQL] Query returns UnsupportedOperationException when scalar subquery is present in partitioning expression

2018-04-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 07ec75ca0 -> 4a10df0f6 [SPARK-24085][SQL] Query returns UnsupportedOperationException when scalar subquery is present in partitioning expression ## What changes were proposed in this pull request? In this case, the partition pruning ha

spark git commit: [SPARK-24085][SQL] Query returns UnsupportedOperationException when scalar subquery is present in partitioning expression

2018-04-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 2824f12b8 -> 3fd297af6 [SPARK-24085][SQL] Query returns UnsupportedOperationException when scalar subquery is present in partitioning expression ## What changes were proposed in this pull request? In this case, the partition pruning happen

spark git commit: [SPARK-23565][SS] New error message for structured streaming sources assertion

2018-04-27 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 109935fc5 -> 2824f12b8 [SPARK-23565][SS] New error message for structured streaming sources assertion ## What changes were proposed in this pull request? A more informative message to tell you why a structured streaming query cannot conti

svn commit: r26567 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_27_04_01-109935f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Fri Apr 27 11:17:53 2018 New Revision: 26567 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_27_04_01-109935f docs [This commit notification would consist of 1460 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23830][YARN] added check to ensure main method is found

2018-04-27 Thread jshao
Repository: spark Updated Branches: refs/heads/master 8aa1d7b0e -> 109935fc5 [SPARK-23830][YARN] added check to ensure main method is found ## What changes were proposed in this pull request? When a user specifies the wrong class -- or, in fact, a class instead of an object -- Spark throws a

svn commit: r26565 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_27_00_01-8aa1d7b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-27 Thread pwendell
Author: pwendell Date: Fri Apr 27 07:16:54 2018 New Revision: 26565 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_27_00_01-8aa1d7b docs [This commit notification would consist of 1460 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---