spark git commit: [SPARK-25336][SS]Revert SPARK-24863 and SPARK-24748

2018-09-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ca861fea2 -> 2119e518d [SPARK-25336][SS]Revert SPARK-24863 and SPARK-24748 ## What changes were proposed in this pull request? Revert SPARK-24863 (#21819) and SPARK-24748 (#21721) as per discussion in #21721. We will revisit them when the

svn commit: r29145 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_04_20_01-ca861fe-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-04 Thread pwendell
Author: pwendell Date: Wed Sep 5 03:15:54 2018 New Revision: 29145 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_04_20_01-ca861fe docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25300][CORE] Unified the configuration parameter `spark.shuffle.service.enabled`

2018-09-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 103f51323 -> ca861fea2 [SPARK-25300][CORE] Unified the configuration parameter `spark.shuffle.service.enabled` ## What changes were proposed in this pull request? The configuration parameter "spark.shuffle.service.enabled" has defined in

spark git commit: [SPARK-25306][SQL] Avoid skewed filter trees to speed up `createFilter` in ORC

2018-09-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 061bb01d9 -> 103f51323 [SPARK-25306][SQL] Avoid skewed filter trees to speed up `createFilter` in ORC ## What changes were proposed in this pull request? In both ORC data sources, `createFilter` function has exponential time complexity du

spark-website git commit: Added Yinan Li to the list of committers

2018-09-04 Thread lixiao
Repository: spark-website Updated Branches: refs/heads/asf-site 92a85c6c2 -> afdb6cbb8 Added Yinan Li to the list of committers Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/afdb6cbb Tree: http://git-wip-

svn commit: r29133 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_04_12_02-061bb01-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-04 Thread pwendell
Author: pwendell Date: Tue Sep 4 19:16:18 2018 New Revision: 29133 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_04_12_02-061bb01 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25248][CORE] Audit barrier Scala APIs for 2.4

2018-09-04 Thread meng
Repository: spark Updated Branches: refs/heads/master 3aa60282c -> 061bb01d9 [SPARK-25248][CORE] Audit barrier Scala APIs for 2.4 ## What changes were proposed in this pull request? I made one pass over barrier APIs added to Spark 2.4 and updates some scopes and docs. I will update Python do

spark git commit: [SPARK-19355][SQL][FOLLOWUP][TEST] Properly recycle SparkSession on TakeOrderedAndProjectSuite finishes

2018-09-04 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0b9b6b7d1 -> 3aa60282c [SPARK-19355][SQL][FOLLOWUP][TEST] Properly recycle SparkSession on TakeOrderedAndProjectSuite finishes ## What changes were proposed in this pull request? Previously in `TakeOrderedAndProjectSuite` the SparkSession

svn commit: r29128 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_04_08_02-0b9b6b7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-04 Thread pwendell
Author: pwendell Date: Tue Sep 4 15:16:34 2018 New Revision: 29128 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_04_08_02-0b9b6b7 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [DOC] Update some outdated links

2018-09-04 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master e319ac92e -> 0b9b6b7d1 [DOC] Update some outdated links ## What changes were proposed in this pull request? These links are outdated: - http://spark.apache.org/docs/latest/building-spark.html#specifying-the-hadoop-version - http://spar

svn commit: r29123 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_04_04_02-e319ac9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-04 Thread pwendell
Author: pwendell Date: Tue Sep 4 11:16:36 2018 New Revision: 29123 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_04_04_02-e319ac9 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24962][SQL] Refactor CodeGenerator.createUnsafeArray, ArraySetLike, and ArrayDistinct

2018-09-04 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 4cb2ff9d8 -> e319ac92e [SPARK-24962][SQL] Refactor CodeGenerator.createUnsafeArray, ArraySetLike, and ArrayDistinct ## What changes were proposed in this pull request? This PR integrates handling of `UnsafeArrayData` and `GenericArrayData

svn commit: r29120 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_04_00_02-4cb2ff9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-04 Thread pwendell
Author: pwendell Date: Tue Sep 4 07:16:45 2018 New Revision: 29120 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_04_00_02-4cb2ff9 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---