spark-website git commit: Fix wrong user list email address

2017-06-02 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 80f50ecca -> 004856aaa Fix wrong user list email address Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/004856aa Tree: http://git-wip-us.apac

spark git commit: [MINOR][PYTHON] Ignore pep8 on test scripts generated in tests in work directory

2017-06-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2134196a9 -> 0e31e28d4 [MINOR][PYTHON] Ignore pep8 on test scripts generated in tests in work directory ## What changes were proposed in this pull request? Currently, if we run `./python/run-tests.py` and they are aborted without cleaning

spark git commit: [SPARK-20942][WEB-UI] The title style about field is error in the history server web ui.

2017-06-02 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0e31e28d4 -> 625cebfde [SPARK-20942][WEB-UI] The title style about field is error in the history server web ui. ## What changes were proposed in this pull request? 1.The title style about field is error. fix before: ![before](https://clou

spark git commit: [SPARK-20942][WEB-UI] The title style about field is error in the history server web ui.

2017-06-02 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 bb3d900b4 -> 25cc80066 [SPARK-20942][WEB-UI] The title style about field is error in the history server web ui. ## What changes were proposed in this pull request? 1.The title style about field is error. fix before: ![before](https://

spark git commit: [SPARK-20967][SQL] SharedState.externalCatalog is not really lazy

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 25cc80066 -> ae00d49af [SPARK-20967][SQL] SharedState.externalCatalog is not really lazy ## What changes were proposed in this pull request? `SharedState.externalCatalog` is marked as a `lazy val` but actually it's not lazy. We access

spark git commit: [SPARK-20967][SQL] SharedState.externalCatalog is not really lazy

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 625cebfde -> d1b80ab92 [SPARK-20967][SQL] SharedState.externalCatalog is not really lazy ## What changes were proposed in this pull request? `SharedState.externalCatalog` is marked as a `lazy val` but actually it's not lazy. We access `ex

spark git commit: [SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d1b80ab92 -> e11d90bf8 [SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate ## What changes were proposed in this pull request? The current conf setting logic is a little complex and has duplication, this PR si

spark git commit: [SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 ae00d49af -> f36c3ee49 [SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate ## What changes were proposed in this pull request? The current conf setting logic is a little complex and has duplication, this PR

spark git commit: [SPARK-20955][CORE] Intern "executorId" to reduce the memory usage

2017-06-02 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 f36c3ee49 -> 7f35f5b99 [SPARK-20955][CORE] Intern "executorId" to reduce the memory usage ## What changes were proposed in this pull request? In [this line](https://github.com/apache/spark/blob/f7cf2096fdecb8edab61c8973c07c6fc877ee32d

spark git commit: [SPARK-20955][CORE] Intern "executorId" to reduce the memory usage

2017-06-02 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master e11d90bf8 -> 16186cdcb [SPARK-20955][CORE] Intern "executorId" to reduce the memory usage ## What changes were proposed in this pull request? In [this line](https://github.com/apache/spark/blob/f7cf2096fdecb8edab61c8973c07c6fc877ee32d/cor

spark git commit: [SPARK-19236][SQL][BACKPORT-2.2] Added createOrReplaceGlobalTempView method

2017-06-02 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 7f35f5b99 -> 9a4a8e1b0 [SPARK-19236][SQL][BACKPORT-2.2] Added createOrReplaceGlobalTempView method ### What changes were proposed in this pull request? This PR is to backport two PRs for adding the `createOrReplaceGlobalTempView` meth

[2/2] spark git commit: Preparing development version 2.2.0-SNAPSHOT

2017-06-02 Thread pwendell
Preparing development version 2.2.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0c422794 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0c422794 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0c4

[spark] Git Push Summary

2017-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.2.0-rc3 [created] cc5dbd55b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.2.0-rc3

2017-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.2 9a4a8e1b0 -> 0c4227940 Preparing Spark release v2.2.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cc5dbd55 Tree: http://git-wip-us.apache.org/repos/asf/spar

spark git commit: [MINOR][SQL] Update the description of spark.sql.files.ignoreCorruptFiles and spark.sql.columnNameOfCorruptRecord

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 16186cdcb -> 2a780ac7f [MINOR][SQL] Update the description of spark.sql.files.ignoreCorruptFiles and spark.sql.columnNameOfCorruptRecord ### What changes were proposed in this pull request? 1. The description of `spark.sql.files.ignoreCorr

spark git commit: [MINOR][SQL] Update the description of spark.sql.files.ignoreCorruptFiles and spark.sql.columnNameOfCorruptRecord

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 0c4227940 -> 6c628e75e [MINOR][SQL] Update the description of spark.sql.files.ignoreCorruptFiles and spark.sql.columnNameOfCorruptRecord ### What changes were proposed in this pull request? 1. The description of `spark.sql.files.ignore

spark git commit: Revert "[SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate"

2017-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 2a780ac7f -> 0eb1fc6cd Revert "[SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate" This reverts commit e11d90bf8deb553fd41b8837e3856c11486c2503. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Com

spark git commit: Revert "[SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate"

2017-06-02 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.2 6c628e75e -> b560c975b Revert "[SPARK-20946][SQL] simplify the config setting logic in SparkSession.getOrCreate" This reverts commit e11d90bf8deb553fd41b8837e3856c11486c2503. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

[spark] Git Push Summary

2017-06-02 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.2.0-rc4 [created] 377cfa8ac - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.2.1-SNAPSHOT

2017-06-02 Thread pwendell
Preparing development version 2.2.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/478874ef Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/478874ef Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/478

[1/2] spark git commit: Preparing Spark release v2.2.0-rc4

2017-06-02 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.2 b560c975b -> 478874eff Preparing Spark release v2.2.0-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/377cfa8a Tree: http://git-wip-us.apache.org/repos/asf/spar

spark git commit: [SPARK-17078][SQL][FOLLOWUP] Simplify explain cost command

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 0eb1fc6cd -> 6de41e951 [SPARK-17078][SQL][FOLLOWUP] Simplify explain cost command ## What changes were proposed in this pull request? Usually when using explain cost command, users want to see the stats of plan. Since stats is only showed

spark git commit: [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6de41e951 -> 864d94fe8 [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes ## What changes were proposed in this pull request? REPL module depends on SQL module, so we should run REPL tests if SQL module has code

spark git commit: [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 478874eff -> c8bbab664 [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes ## What changes were proposed in this pull request? REPL module depends on SQL module, so we should run REPL tests if SQL module has c

spark git commit: [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 0b25a7d93 -> afab8557b [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes ## What changes were proposed in this pull request? REPL module depends on SQL module, so we should run REPL tests if SQL module has c

spark git commit: [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes

2017-06-02 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 9952b53b5 -> 0f3598820 [SPARK-20974][BUILD] we should run REPL tests if SQL module has code changes ## What changes were proposed in this pull request? REPL module depends on SQL module, so we should run REPL tests if SQL module has c

spark git commit: [SPARK-19732][SQL][PYSPARK] Add fill functions for nulls in bool fields of datasets

2017-06-02 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 864d94fe8 -> 6cbc61d10 [SPARK-19732][SQL][PYSPARK] Add fill functions for nulls in bool fields of datasets ## What changes were proposed in this pull request? Allow fill/replace of NAs with booleans, both in Python and Scala ## How was t