spark git commit: [SPARK-20665][SQL][FOLLOW-UP] Move test case to MathExpressionsSuite

Repository: spark Updated Branches: refs/heads/master 3476390c6 -> d14091809 [SPARK-20665][SQL][FOLLOW-UP] Move test case to MathExpressionsSuite ## What changes were proposed in this pull request? add test case to MathExpressionsSuite as #17906 ## How was this patch tested? unit test

spark git commit: [SPARK-20715] Store MapStatuses only in MapOutputTracker, not ShuffleMapStage

Repository: spark Updated Branches: refs/heads/master f48273c13 -> 3476390c6 [SPARK-20715] Store MapStatuses only in MapOutputTracker, not ShuffleMapStage ## What changes were proposed in this pull request? This PR refactors `ShuffleMapStage` and `MapOutputTracker` in order to simplify the

spark git commit: [SPARK-18891][SQL] Support for specific Java List subtypes

Repository: spark Updated Branches: refs/heads/master 0538f3b0a -> f48273c13 [SPARK-18891][SQL] Support for specific Java List subtypes ## What changes were proposed in this pull request? Add support for specific Java `List` subtypes in deserialization as well as a generic implicit encoder.

spark git commit: [SPARK-18891][SQL] Support for Scala Map collection types

Repository: spark Updated Branches: refs/heads/master a7c61c100 -> 0538f3b0a [SPARK-18891][SQL] Support for Scala Map collection types ## What changes were proposed in this pull request? Add support for arbitrary Scala `Map` types in deserialization as well as a generic implicit encoder.

spark git commit: [SPARK-21031][SQL] Add `alterTableStats` to store spark's stats and let `alterTable` keep existing stats

Repository: spark Updated Branches: refs/heads/master 3a840048e -> a7c61c100 [SPARK-21031][SQL] Add `alterTableStats` to store spark's stats and let `alterTable` keep existing stats ## What changes were proposed in this pull request? Currently, hive's stats are read into

spark git commit: Fixed typo in sql.functions

Repository: spark Updated Branches: refs/heads/master 9f4ff9552 -> 3a840048e Fixed typo in sql.functions ## What changes were proposed in this pull request? I fixed a typo in the Scaladoc for the method `def struct(cols: Column*): Column`. 'retained' was misspelt as 'remained'. ## How was

spark git commit: [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move

Repository: spark Updated Branches: refs/heads/branch-2.2 0b0be47e7 -> 26003de55 [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move clean up after big test move unit tests, jenkins Author: Felix Cheung Closes #18267 from felixcheung/rtestset2. (cherry

spark git commit: [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move

Repository: spark Updated Branches: refs/heads/master 823f1eef5 -> 9f4ff9552 [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move ## What changes were proposed in this pull request? clean up after big test move ## How was this patch tested? unit tests, jenkins Author: Felix Cheung

spark git commit: [SPARK-13933][BUILD] Update hadoop-2.7 profile's curator version to 2.7.1

Repository: spark Updated Branches: refs/heads/master eb3ea3a08 -> 823f1eef5 [SPARK-13933][BUILD] Update hadoop-2.7 profile's curator version to 2.7.1 ## What changes were proposed in this pull request? Update hadoop-2.7 profile's curator version to 2.7.1, more see

spark git commit: [SPARK-20935][STREAMING] Always close WriteAheadLog and make it idempotent

Repository: spark Updated Branches: refs/heads/master 8da3f7041 -> eb3ea3a08 [SPARK-20935][STREAMING] Always close WriteAheadLog and make it idempotent ## What changes were proposed in this pull request? This PR proposes to stop `ReceiverTracker` to close `WriteAheadLog` whenever it is and

spark git commit: [SPARK-21000][MESOS] Add Mesos labels support to the Spark Dispatcher

Repository: spark Updated Branches: refs/heads/master dc4c35183 -> 8da3f7041 [SPARK-21000][MESOS] Add Mesos labels support to the Spark Dispatcher ## What changes were proposed in this pull request? Add Mesos labels support to the Spark Dispatcher ## How was this patch tested? unit tests

[1/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

Repository: spark Updated Branches: refs/heads/branch-2.2 815a0820b -> 0b0be47e7 http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/tests/fulltests/test_streaming.R -- diff --git

[5/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[2/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/tests/fulltests/test_sparkSQL.R -- diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R new file mode 100644 index

[7/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

[SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN ## What changes were proposed in this pull request? Move all existing tests to non-installed directory so that it will never run by installing SparkR package For a follow-up PR: - remove all skip_on_cran() calls in tests - clean

[5/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[7/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

[SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN ## What changes were proposed in this pull request? Move all existing tests to non-installed directory so that it will never run by installing SparkR package For a follow-up PR: - remove all skip_on_cran() calls in tests - clean

[6/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_mllib_regression.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib_regression.R b/R/pkg/inst/tests/testthat/test_mllib_regression.R

[4/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_streaming.R -- diff --git a/R/pkg/inst/tests/testthat/test_streaming.R b/R/pkg/inst/tests/testthat/test_streaming.R deleted file mode

[4/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_streaming.R -- diff --git a/R/pkg/inst/tests/testthat/test_streaming.R b/R/pkg/inst/tests/testthat/test_streaming.R deleted file mode

[1/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

Repository: spark Updated Branches: refs/heads/master 5301a19a0 -> dc4c35183 http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/tests/fulltests/test_streaming.R -- diff --git

[2/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/tests/fulltests/test_sparkSQL.R -- diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R new file mode 100644 index

[3/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/tests/fulltests/test_mllib_fpm.R -- diff --git a/R/pkg/tests/fulltests/test_mllib_fpm.R b/R/pkg/tests/fulltests/test_mllib_fpm.R new file mode 100644 index

[3/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/tests/fulltests/test_mllib_fpm.R -- diff --git a/R/pkg/tests/fulltests/test_mllib_fpm.R b/R/pkg/tests/fulltests/test_mllib_fpm.R new file mode 100644 index

[6/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_mllib_regression.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib_regression.R b/R/pkg/inst/tests/testthat/test_mllib_regression.R