spark git commit: [SPARK-25089][R] removing lintr checks for 2.0

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 dccd8c754 -> 5ed89ceaf [SPARK-25089][R] removing lintr checks for 2.0 ## What changes were proposed in this pull request? since 2.0 will be EOLed some time in the not too distant future, and we'll be moving the builds from centos to

spark git commit: [SPARK-25089][R] removing lintr checks for 2.1

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 42229430f -> 09f70f5fd [SPARK-25089][R] removing lintr checks for 2.1 ## What changes were proposed in this pull request? since 2.1 will be EOLed some time in the not too distant future, and we'll be moving the builds from centos to

spark git commit: [SPARK-24908][R][STYLE] removing spaces to make lintr happy

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 04c652064 -> a0a7e41cf [SPARK-24908][R][STYLE] removing spaces to make lintr happy ## What changes were proposed in this pull request? during my travails in porting spark builds to run on our centos worker, i managed to recreate (as

svn commit: r28663 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_12_02-f5aba65-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 19:16:32 2018 New Revision: 28663 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_12_02-f5aba65 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page

2018-08-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.3 7306ac71d -> 04c652064 [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page ## What changes were proposed in this pull request? This issue is pretty similar to

spark git commit: [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page

2018-08-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 91cdab51c -> f5aba6573 [SPARK-25081][CORE] Nested spill in ShuffleExternalSorter should not access released memory page ## What changes were proposed in this pull request? This issue is pretty similar to

svn commit: r28661 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_10_10_02-7306ac7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 17:15:48 2018 New Revision: 28661 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_10_10_02-7306ac7 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 b283c1f05 -> 051ea3a62 [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html Add ECCN notice required by http://www.apache.org/dev/crypto.html See https://issues.apache.org/jira/browse/LEGAL-398 This should

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 e66f3f9b1 -> 7306ac71d [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html Add ECCN notice required by http://www.apache.org/dev/crypto.html See https://issues.apache.org/jira/browse/LEGAL-398 This should

spark git commit: [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 1dd0f1744 -> 91cdab51c [MINOR][BUILD] Add ECCN notice required by http://www.apache.org/dev/crypto.html ## What changes were proposed in this pull request? Add ECCN notice required by http://www.apache.org/dev/crypto.html See

svn commit: r28657 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_08_02-1dd0f17-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 15:16:21 2018 New Revision: 28657 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_08_02-1dd0f17 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25036][SQL] Avoid discarding unmoored doc comment in Scala-2.12.

2018-08-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4f1758509 -> 132bcceeb [SPARK-25036][SQL] Avoid discarding unmoored doc comment in Scala-2.12. ## What changes were proposed in this pull request? This PR avoid the following compilation error using sbt in Scala-2.12. ``` [error] [warn]

svn commit: r28651 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_04_02-4f17585-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 11:20:55 2018 New Revision: 28651 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_04_02-4f17585 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-19355][SQL] Use map output statistics to improve global limit's parallelism

2018-08-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 9abe09bfc -> 4f1758509 [SPARK-19355][SQL] Use map output statistics to improve global limit's parallelism ## What changes were proposed in this pull request? A logical `Limit` is performed physically by two operations `LocalLimit` and

spark git commit: [SPARK-24127][SS] Continuous text socket source

2018-08-10 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master ab1029fb8 -> 9abe09bfc [SPARK-24127][SS] Continuous text socket source ## What changes were proposed in this pull request? Support for text socket stream in spark structured streaming "continuous" mode. This is roughly based on the idea

svn commit: r28650 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_10_00_02-ab1029f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-10 Thread pwendell
Author: pwendell Date: Fri Aug 10 07:16:55 2018 New Revision: 28650 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_10_00_02-ab1029f docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23912][SQL][FOLLOWUP] Refactor ArrayDistinct

2018-08-10 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 0cea9e3cd -> ab1029fb8 [SPARK-23912][SQL][FOLLOWUP] Refactor ArrayDistinct ## What changes were proposed in this pull request? This PR simplified code generation for `ArrayDistinct`. #21966 enabled code generation only if the type can be