spark git commit: [SPARK-24337][CORE] Improve error messages for Spark conf values

2018-05-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 24ef7fbfa -> 0053e153f [SPARK-24337][CORE] Improve error messages for Spark conf values ## What changes were proposed in this pull request? Improve the exception messages when retrieving Spark conf values to include the key name when the

svn commit: r27183 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_30_16_01-24ef7fb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 23:16:34 2018 New Revision: 27183 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_30_16_01-24ef7fb docs [This commit notification would consist of 1465 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24276][SQL] Order of literals in IN should not affect semantic equality

2018-05-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 1b36f1488 -> 24ef7fbfa [SPARK-24276][SQL] Order of literals in IN should not affect semantic equality ## What changes were proposed in this pull request? When two `In` operators are created with the same list of values, but different

svn commit: r27182 - in /dev/spark/2.3.2-SNAPSHOT-2018_05_30_14_01-3a024a4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 21:16:14 2018 New Revision: 27182 Log: Apache Spark 2.3.2-SNAPSHOT-2018_05_30_14_01-3a024a4 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23901][SQL] Add masking functions

2018-05-30 Thread ueshin
Repository: spark Updated Branches: refs/heads/master ec6f971dc -> 1b36f1488 [SPARK-23901][SQL] Add masking functions ## What changes were proposed in this pull request? The PR adds the masking function as they are described in Hive's documentation:

spark git commit: [SPARK-23161][PYSPARK][ML] Add missing APIs to Python GBTClassifier

2018-05-30 Thread cutlerb
Repository: spark Updated Branches: refs/heads/master b142157dc -> ec6f971dc [SPARK-23161][PYSPARK][ML] Add missing APIs to Python GBTClassifier ## What changes were proposed in this pull request? Add featureSubsetStrategy in GBTClassifier and GBTRegressor. Also make GBTClassificationModel

spark git commit: [SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit

2018-05-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 e1c0ab16c -> 3a024a4db [SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit ## What changes were proposed in this pull request? In client side before context

spark git commit: [SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit

2018-05-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 1e46f92f9 -> b142157dc [SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit ## What changes were proposed in this pull request? In client side before context

svn commit: r27175 - in /dev/spark/2.3.2-SNAPSHOT-2018_05_30_10_01-e1c0ab1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 17:16:57 2018 New Revision: 27175 Log: Apache Spark 2.3.2-SNAPSHOT-2018_05_30_10_01-e1c0ab1 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23754][BRANCH-2.3][PYTHON] Re-raising StopIteration in client code

2018-05-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 66289a3e0 -> e1c0ab16c [SPARK-23754][BRANCH-2.3][PYTHON] Re-raising StopIteration in client code ## What changes are proposed Make sure that `StopIteration`s raised in users' code do not silently interrupt processing by spark, but are

spark git commit: [SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

2018-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 49a6c2b91 -> 66289a3e0 [SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set ## What changes were proposed in this pull request? This pr fixed an issue when having multiple distinct

spark git commit: [SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

2018-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9e7bad0ed -> 1e46f92f9 [SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set ## What changes were proposed in this pull request? This pr fixed an issue when having multiple distinct

svn commit: r27173 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_30_08_01-9e7bad0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 15:18:40 2018 New Revision: 27173 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_30_08_01-9e7bad0 docs [This commit notification would consist of 1465 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24419][BUILD] Upgrade SBT to 0.13.17 with Scala 2.10.7 for JDK9+

2018-05-30 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 0ebb0c0d4 -> 9e7bad0ed [SPARK-24419][BUILD] Upgrade SBT to 0.13.17 with Scala 2.10.7 for JDK9+ ## What changes were proposed in this pull request? Upgrade SBT to 0.13.17 with Scala 2.10.7 for JDK9+ ## How was this patch tested? Existing

svn commit: r27168 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_30_04_02-0ebb0c0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 11:22:39 2018 New Revision: 27168 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_30_04_02-0ebb0c0 docs [This commit notification would consist of 1465 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23754][PYTHON] Re-raising StopIteration in client code

2018-05-30 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master a4be981c0 -> 0ebb0c0d4 [SPARK-23754][PYTHON] Re-raising StopIteration in client code ## What changes were proposed in this pull request? Make sure that `StopIteration`s raised in users' code do not silently interrupt processing by spark,

svn commit: r27157 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_30_00_01-a4be981-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-30 Thread pwendell
Author: pwendell Date: Wed May 30 07:17:29 2018 New Revision: 27157 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_30_00_01-a4be981 docs [This commit notification would consist of 1465 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR

2018-05-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master f48938800 -> a4be981c0 [SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR ## What changes were proposed in this pull request? The PR adds functions `arrays_overlap`, `array_repeat`, `map_entries` to