svn commit: r27391 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_12_00_01-01452ea-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 07:17:35 2018 New Revision: 27391 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_12_00_01-01452ea docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27394 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_12_02_01-bf58687-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 09:16:47 2018 New Revision: 27394 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_12_02_01-bf58687 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-15064][ML] Locale support in StopWordsRemover

2018-06-12 Thread meng
Repository: spark Updated Branches: refs/heads/master 1d7db65e9 -> 5d6a53d98 [SPARK-15064][ML] Locale support in StopWordsRemover ## What changes were proposed in this pull request? Add locale support for `StopWordsRemover`. ## How was this patch tested? [Scala|Python] unit tests. Author:

svn commit: r27399 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_12_08_01-1d7db65-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 15:16:36 2018 New Revision: 27399 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_12_08_01-1d7db65 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24416] Fix configuration specification for killBlacklisted executors

2018-06-12 Thread irashid
Repository: spark Updated Branches: refs/heads/master 2824f1436 -> 3af1d3e6d [SPARK-24416] Fix configuration specification for killBlacklisted executors ## What changes were proposed in this pull request? spark.blacklist.killBlacklistedExecutors is defined as (Experimental) If set to

spark git commit: [SPARK-22239][SQL][PYTHON] Enable grouped aggregate pandas UDFs as window functions with unbounded window frames

2018-06-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f53818d35 -> 9786ce66c [SPARK-22239][SQL][PYTHON] Enable grouped aggregate pandas UDFs as window functions with unbounded window frames ## What changes were proposed in this pull request? This PR enables using a grouped aggregate pandas

spark git commit: [SPARK-24466][SS] Fix TextSocketMicroBatchReader to be compatible with netcat again

2018-06-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9786ce66c -> 3352d6fe9 [SPARK-24466][SS] Fix TextSocketMicroBatchReader to be compatible with netcat again ## What changes were proposed in this pull request? TextSocketMicroBatchReader was no longer be compatible with netcat due to

spark git commit: [SPARK-23010][BUILD][FOLLOWUP] Fix java checkstyle failure of kubernetes-integration-tests

2018-06-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master ada28f259 -> 0d3714d22 [SPARK-23010][BUILD][FOLLOWUP] Fix java checkstyle failure of kubernetes-integration-tests ## What changes were proposed in this pull request? Fix java checkstyle failure of kubernetes-integration-tests ## How was

spark git commit: [SPARK-24506][UI] Add UI filters to tabs added after binding

2018-06-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 bf0b21298 -> 1f81ade0c [SPARK-24506][UI] Add UI filters to tabs added after binding Currently, `spark.ui.filters` are not applied to the handlers added after binding the server. This means that every page which is added after starting

spark git commit: [SPARK-24485][SS] Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider

2018-06-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 3352d6fe9 -> 4c388bccf [SPARK-24485][SS] Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider ## What changes were proposed in this pull request? This patch measures and logs elapsed time for each

svn commit: r27415 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_12_22_01-470cacd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Wed Jun 13 05:16:07 2018 New Revision: 27415 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_12_22_01-470cacd docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23754][PYTHON][FOLLOWUP][BACKPORT-2.3] Move UDF stop iteration wrapping from driver to executor

2018-06-12 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 a55de387d -> 470cacd49 [SPARK-23754][PYTHON][FOLLOWUP][BACKPORT-2.3] Move UDF stop iteration wrapping from driver to executor SPARK-23754 was fixed in #21383 by changing the UDF code to wrap the user function, but this required a

svn commit: r27413 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_12_18_02-a55de38-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Wed Jun 13 01:15:30 2018 New Revision: 27413 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_12_18_02-a55de38 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27414 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_12_20_01-9786ce6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Wed Jun 13 03:16:25 2018 New Revision: 27414 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_12_20_01-9786ce6 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27412 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_12_16_01-0d3714d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 23:15:35 2018 New Revision: 27412 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_12_16_01-0d3714d docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24506][UI] Add UI filters to tabs added after binding

2018-06-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 0d3714d22 -> f53818d35 [SPARK-24506][UI] Add UI filters to tabs added after binding ## What changes were proposed in this pull request? Currently, `spark.ui.filters` are not applied to the handlers added after binding the server. This

spark git commit: [SPARK-24506][UI] Add UI filters to tabs added after binding

2018-06-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 63e1da162 -> a55de387d [SPARK-24506][UI] Add UI filters to tabs added after binding ## What changes were proposed in this pull request? Currently, `spark.ui.filters` are not applied to the handlers added after binding the server.

spark git commit: [SPARK-23933][SQL] Add map_from_arrays function

2018-06-12 Thread ueshin
Repository: spark Updated Branches: refs/heads/master cc88d7fad -> ada28f259 [SPARK-23933][SQL] Add map_from_arrays function ## What changes were proposed in this pull request? The PR adds the SQL function `map_from_arrays`. The behavior of the function is based on Presto's `map`. Since

spark git commit: [SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in scala

2018-06-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f0ef1b311 -> cc88d7fad [SPARK-24216][SQL] Spark TypedAggregateExpression uses getSimpleName that is not safe in scala ## What changes were proposed in this pull request? When user create a aggregator object in scala and pass the

spark git commit: [SPARK-23931][SQL] Adds arrays_zip function to sparksql

2018-06-12 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 3af1d3e6d -> f0ef1b311 [SPARK-23931][SQL] Adds arrays_zip function to sparksql Signed-off-by: DylanGuedes ## What changes were proposed in this pull request? Addition of arrays_zip function to spark sql functions. ## How was this patch

svn commit: r27409 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_12_12_02-f0ef1b3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 19:19:06 2018 New Revision: 27409 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_12_12_02-f0ef1b3 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: docs: fix typo

2018-06-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 01452ea9c -> 1d7db65e9 docs: fix typo no => no[t] ## What changes were proposed in this pull request? Fixing a typo. ## How was this patch tested? Visual check of the docs. Please review http://spark.apache.org/contributing.html

spark-website git commit: Updates to the release guide.

2018-06-12 Thread vanzin
Repository: spark-website Updated Branches: refs/heads/asf-site cea85ce67 -> eb97812f5 Updates to the release guide. - Fix dangerous commands that would flood the ASF repo with requests. - Add instruction for updating release KEYS. - Fix the PyPI instructions (including link to the message on

spark git commit: [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite

2018-06-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 bf5868757 -> 63e1da162 [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite ## What changes were proposed in this pull request? Removing version 2.2.0 from testing versions in

spark git commit: [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite

2018-06-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 c306a8461 -> bf0b21298 [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite Removing version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite as it is not present anymore

svn commit: r27404 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_12_10_01-63e1da1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-12 Thread pwendell
Author: pwendell Date: Tue Jun 12 17:15:46 2018 New Revision: 27404 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_12_10_01-63e1da1 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite

2018-06-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 5d6a53d98 -> 2824f1436 [SPARK-24531][TESTS] Remove version 2.2.0 from testing versions in HiveExternalCatalogVersionsSuite ## What changes were proposed in this pull request? Removing version 2.2.0 from testing versions in