svn commit: r28650 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_00_02-ab1029f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 07:16:55 2018 New Revision: 28650 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_00_02-ab1029f docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24127][SS] Continuous text socket source

2018-08-10 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master ab1029fb8 -> 9abe09bfc [SPARK-24127][SS] Continuous text socket source ## What changes were proposed in this pull request? Support for text socket stream in spark structured streaming "continuous" mode. This is roughly based on the idea o

spark git commit: [SPARK-19355][SQL] Use map output statistics to improve global limit's parallelism

2018-08-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 9abe09bfc -> 4f1758509 [SPARK-19355][SQL] Use map output statistics to improve global limit's parallelism ## What changes were proposed in this pull request? A logical `Limit` is performed physically by two operations `LocalLimit` and `G

svn commit: r28651 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_04_02-4f17585-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 11:20:55 2018 New Revision: 28651 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_04_02-4f17585 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25036][SQL] Avoid discarding unmoored doc comment in Scala-2.12.

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4f1758509 -> 132bcceeb [SPARK-25036][SQL] Avoid discarding unmoored doc comment in Scala-2.12. ## What changes were proposed in this pull request? This PR avoid the following compilation error using sbt in Scala-2.12. ``` [error] [warn]

spark git commit: [SPARK-25036][SQL][FOLLOW-UP] Avoid match may not be exhaustive in Scala-2.12.

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 132bcceeb -> 1dd0f1744 [SPARK-25036][SQL][FOLLOW-UP] Avoid match may not be exhaustive in Scala-2.12. ## What changes were proposed in this pull request? This is a follow-up pr of #22014 and #22039 We still have some more compilation erro

svn commit: r28657 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_08_02-1dd0f17-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 15:16:21 2018 New Revision: 28657 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_08_02-1dd0f17 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1dd0f1744 -> 91cdab51c [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html ## What changes were proposed in this pull request? Add ECCN notice required by http://www.apache.org/dev/crypto.html See https://issue

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 e66f3f9b1 -> 7306ac71d [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html Add ECCN notice required by http://www.apache.org/dev/crypto.html See https://issues.apache.org/jira/browse/LEGAL-398 This should p

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 b283c1f05 -> 051ea3a62 [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html Add ECCN notice required by http://www.apache.org/dev/crypto.html See https://issues.apache.org/jira/browse/LEGAL-398 This should p

svn commit: r28661 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_10_10_02-7306ac7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 17:15:48 2018 New Revision: 28661 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_10_10_02-7306ac7 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page

2018-08-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 91cdab51c -> f5aba6573 [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page ## What changes were proposed in this pull request? This issue is pretty similar to [SPARK-21907](https://issues.apac

spark git commit: [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page

2018-08-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.3 7306ac71d -> 04c652064 [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page ## What changes were proposed in this pull request? This issue is pretty similar to [SPARK-21907](https://issues.

svn commit: r28663 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_12_02-f5aba65-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 19:16:32 2018 New Revision: 28663 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_12_02-f5aba65 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24908][R][STYLE] removing spaces to make lintr happy

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 04c652064 -> a0a7e41cf [SPARK-24908][R][STYLE] removing spaces to make lintr happy ## What changes were proposed in this pull request? during my travails in porting spark builds to run on our centos worker, i managed to recreate (as b

spark git commit: [SPARK-25089][R] removing lintr checks for 2.1

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 42229430f -> 09f70f5fd [SPARK-25089][R] removing lintr checks for 2.1 ## What changes were proposed in this pull request? since 2.1 will be EOLed some time in the not too distant future, and we'll be moving the builds from centos to u

spark git commit: [SPARK-25089][R] removing lintr checks for 2.0

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 dccd8c754 -> 5ed89ceaf [SPARK-25089][R] removing lintr checks for 2.0 ## What changes were proposed in this pull request? since 2.0 will be EOLed some time in the not too distant future, and we'll be moving the builds from centos to u