svn commit: r29928 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_07_12_02-ebd899b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-07 Thread pwendell
Author: pwendell Date: Sun Oct 7 19:17:10 2018 New Revision: 29928 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_07_12_02-ebd899b docs [This commit notification would consist of 1481 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25321][ML] Revert SPARK-14681 to avoid API breaking change

2018-10-07 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 669ade3a8 -> ebd899b8a [SPARK-25321][ML] Revert SPARK-14681 to avoid API breaking change ## What changes were proposed in this pull request? This is the same as #22492 but for master branch. Revert SPARK-14681 to avoid API breaking

spark git commit: [SPARK-25657][SQL][TEST] Refactor HashBenchmark to use main method

2018-10-07 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master b1328cc58 -> 669ade3a8 [SPARK-25657][SQL][TEST] Refactor HashBenchmark to use main method ## What changes were proposed in this pull request? Refactor `HashBenchmark` to use main method. 1. use `spark-submit`: ```console bin/spark-submit

spark git commit: [SPARK-25658][SQL][TEST] Refactor HashByteArrayBenchmark to use main method

2018-10-07 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 3eb842969 -> b1328cc58 [SPARK-25658][SQL][TEST] Refactor HashByteArrayBenchmark to use main method ## What changes were proposed in this pull request? Refactor `HashByteArrayBenchmark` to use main method. 1. use `spark-submit`: ```console

spark git commit: [SPARK-25461][PYSPARK][SQL] Add document for mismatch between return type of Pandas.Series and return type of pandas udf

2018-10-07 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master fba722e31 -> 3eb842969 [SPARK-25461][PYSPARK][SQL] Add document for mismatch between return type of Pandas.Series and return type of pandas udf ## What changes were proposed in this pull request? For Pandas UDFs, we get arrow type from

svn commit: r29927 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_07_08_02-fba722e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-07 Thread pwendell
Author: pwendell Date: Sun Oct 7 15:17:22 2018 New Revision: 29927 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_07_08_02-fba722e docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed improvement

2018-10-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master 8bb242902 -> fba722e31 [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed improvement ## What changes were proposed in this pull request? This PR upgrade `lz4-java` to 1.5.0 get speed improvement. **General speed improvements**