git commit: [HOTFIX] Wait for EOF only for the PySpark shell

Repository: spark Updated Branches: refs/heads/branch-1.1 78e3c036e - 54ccd93e6 [HOTFIX] Wait for EOF only for the PySpark shell In `SparkSubmitDriverBootstrapper`, we wait for the parent process to send us an `EOF` before finishing the application. This is applicable for the PySpark shell

git commit: [HOTFIX] Wait for EOF only for the PySpark shell

Repository: spark Updated Branches: refs/heads/master f38fab97c - dafe34349 [HOTFIX] Wait for EOF only for the PySpark shell In `SparkSubmitDriverBootstrapper`, we wait for the parent process to send us an `EOF` before finishing the application. This is applicable for the PySpark shell

git commit: [HOTFIX][SQL] Remove cleaning of UDFs

Repository: spark Updated Branches: refs/heads/master dafe34349 - 024178c57 [HOTFIX][SQL] Remove cleaning of UDFs It is not safe to run the closure cleaner on slaves. #2153 introduced this which broke all UDF execution on slaves. Will re-add cleaning of UDF closures in a follow-up PR.

git commit: [HOTFIX][SQL] Remove cleaning of UDFs

Repository: spark Updated Branches: refs/heads/branch-1.1 54ccd93e6 - 233c283e3 [HOTFIX][SQL] Remove cleaning of UDFs It is not safe to run the closure cleaner on slaves. #2153 introduced this which broke all UDF execution on slaves. Will re-add cleaning of UDF closures in a follow-up PR.

git commit: HOTFIX: Don't build with YARN support for Mapr3

Repository: spark Updated Branches: refs/heads/branch-1.1 233c283e3 - ad0fab23d HOTFIX: Don't build with YARN support for Mapr3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ad0fab23 Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [deleted] 1dc825d90 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.1 79e86ef3e - a118ea5c5 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a118ea5c Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [created] d6d19b581 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare release v1.1.0-rc1

Repository: spark Updated Branches: refs/heads/branch-1.1 ad0fab23d - 79e86ef3e [maven-release-plugin] prepare release v1.1.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/79e86ef3 Tree:

git commit: [SQL] Fixed 2 comment typos in SQLConf

Repository: spark Updated Branches: refs/heads/master 024178c57 - 68f75dcdf [SQL] Fixed 2 comment typos in SQLConf Author: Cheng Lian lian.cs@gmail.com Closes #2172 from liancheng/sqlconf-typo and squashes the following commits: 115cc71 [Cheng Lian] Fixed 2 comment typos in SQLConf

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [deleted] d6d19b581 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [SPARK-3230][SQL] Fix udfs that return structs

Repository: spark Updated Branches: refs/heads/master 68f75dcdf - 76e3ba426 [SPARK-3230][SQL] Fix udfs that return structs We need to convert the case classes into Rows. Author: Michael Armbrust mich...@databricks.com Closes #2133 from marmbrus/structUdfs and squashes the following commits:

[1/3] git commit: Revert [maven-release-plugin] prepare release v1.1.0-rc1

Repository: spark Updated Branches: refs/heads/branch-1.1 2e8ad9976 - a9df70308 Revert [maven-release-plugin] prepare release v1.1.0-rc1 This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/3] git commit: Revert [maven-release-plugin] prepare for next development iteration

Revert [maven-release-plugin] prepare for next development iteration This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/71ec0140 Tree:

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.1 da4b94c86 - 96926c5a4 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/96926c5a Tree:

[5/8] git commit: Revert [maven-release-plugin] prepare for next development iteration

Revert [maven-release-plugin] prepare for next development iteration This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d01b3faf Tree:

[3/8] git commit: Revert Revert [maven-release-plugin] prepare release v1.1.0-rc1

Revert Revert [maven-release-plugin] prepare release v1.1.0-rc1 This reverts commit 56070f12f455bae645cba887a74c72b12f1085f8. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4186c45f Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.1.0-rc1 [created] c0cb9d6b5 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [maven-release-plugin] prepare release v1.1.0-rc1

Repository: spark Updated Branches: refs/heads/branch-1.1 1d03330ec - f07183249 [maven-release-plugin] prepare release v1.1.0-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f0718324 Tree:

git commit: [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init()

Repository: spark Updated Branches: refs/heads/branch-1.0 edea1efe0 - 31de05b08 [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init() The issue happens when Spark is run standalone on a cluster. When master and driver fall

git commit: [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init()

Repository: spark Updated Branches: refs/heads/branch-1.1 f8f7a0c9d - fd98020a9 [SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing default values in DriverInfo.init() The issue happens when Spark is run standalone on a cluster. When master and driver fall

git commit: [SPARK-3285] [examples] Using values.sum is easier to understand than using values.foldLeft(0)(_ + _)

Repository: spark Updated Branches: refs/heads/master be53c54b5 - 39012452d [SPARK-3285] [examples] Using values.sum is easier to understand than using values.foldLeft(0)(_ + _) def sum[B : A](implicit num: Numeric[B]): B = foldLeft(num.zero)(num.plus) Using values.sum is easier to

git commit: [SPARK-3281] Remove Netty specific code in BlockManager / shuffle

Repository: spark Updated Branches: refs/heads/master 41dc5987d - be53c54b5 [SPARK-3281] Remove Netty specific code in BlockManager / shuffle Netty functionality will be added back in subsequent PRs by using the BlockTransferService interface. Author: Reynold Xin r...@apache.org Closes

git commit: [SPARK-3190] Avoid overflow in VertexRDD.count()

Repository: spark Updated Branches: refs/heads/master 39012452d - 96df92906 [SPARK-3190] Avoid overflow in VertexRDD.count() VertexRDDs with more than 4 billion elements are counted incorrectly due to integer overflow when summing partition sizes. This PR fixes the issue by converting

git commit: [SPARK-3190] Avoid overflow in VertexRDD.count()

Repository: spark Updated Branches: refs/heads/branch-1.0 31de05b08 - 5481196ab [SPARK-3190] Avoid overflow in VertexRDD.count() VertexRDDs with more than 4 billion elements are counted incorrectly due to integer overflow when summing partition sizes. This PR fixes the issue by converting

git commit: SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...

Repository: spark Updated Branches: refs/heads/master 96df92906 - 92af2314f SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste... ...d queue doesn't exist Author: Sandy Ryza sa...@cloudera.com Closes #1984 from sryza/sandy-spark-3082 and squashes the following commits:

git commit: SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...

Repository: spark Updated Branches: refs/heads/branch-1.1 0b9718add - f4cbf5e3d SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste... ...d queue doesn't exist Author: Sandy Ryza sa...@cloudera.com Closes #1984 from sryza/sandy-spark-3082 and squashes the following

git commit: [SPARK-3277] Fix external spilling with LZ4 assertion error

Repository: spark Updated Branches: refs/heads/master 92af2314f - a46b8f2d7 [SPARK-3277] Fix external spilling with LZ4 assertion error **Summary of the changes** The bulk of this PR is comprised of tests and documentation; the actual fix is really just adding 1 line of code (see

git commit: [SPARK-3277] Fix external spilling with LZ4 assertion error

Repository: spark Updated Branches: refs/heads/branch-1.1 f4cbf5e3d - fe4df343d [SPARK-3277] Fix external spilling with LZ4 assertion error **Summary of the changes** The bulk of this PR is comprised of tests and documentation; the actual fix is really just adding 1 line of code (see

[2/3] git commit: Revert [maven-release-plugin] prepare for next development iteration

Revert [maven-release-plugin] prepare for next development iteration This reverts commit f8f7a0c9dce764ece8acdc41d35bbf448dba7e92. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/587dff21 Tree:

[3/3] git commit: Revert [maven-release-plugin] prepare release v1.1.0-rc1

Revert [maven-release-plugin] prepare release v1.1.0-rc1 This reverts commit f07183249b74dd857069028bf7d570b35f265585. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb2b40a5 Tree:

[1/3] git commit: Adding new CHANGES.txt

Repository: spark Updated Branches: refs/heads/branch-1.1 fe4df343d - fb2b40a52 Adding new CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7db87b3e Tree:

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.1 711aebb32 - a4a7a2414 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a4a7a241 Tree:

git commit: [maven-release-plugin] prepare release v1.1.0-rc2

Repository: spark Updated Branches: refs/heads/branch-1.1 fb2b40a52 - 711aebb32 [maven-release-plugin] prepare release v1.1.0-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/711aebb3 Tree:

git commit: [Spark QA] Link to console output on test time out

Repository: spark Updated Branches: refs/heads/master a46b8f2d7 - 3c517a812 [Spark QA] Link to console output on test time out When tests time out we should link to the Jenkins console output for easy review. We already do this for when tests start or complete normally. Here's [a recent

git commit: [SPARK-1912] Lazily initialize buffers for local shuffle blocks.

Repository: spark Updated Branches: refs/heads/master 3c517a812 - 665e71d14 [SPARK-1912] Lazily initialize buffers for local shuffle blocks. This is a simplified fix for SPARK-1912. Author: Reynold Xin r...@apache.org Closes #2179 from rxin/SPARK-1912 and squashes the following commits:

git commit: [SPARK-3279] Remove useless field variable in ApplicationMaster

Repository: spark Updated Branches: refs/heads/master 665e71d14 - 27df6ce6a [SPARK-3279] Remove useless field variable in ApplicationMaster Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #2177 from sarutak/SPARK-3279 and squashes the following commits: 2955edc [Kousuke Saruta]