git commit: SPARK-2657 Use more compact data structures than ArrayBuffer in groupBy cogroup

Repository: spark Updated Branches: refs/heads/master 2f75a4a30 - 8529ced35 SPARK-2657 Use more compact data structures than ArrayBuffer in groupBy cogroup JIRA: https://issues.apache.org/jira/browse/SPARK-2657 Our current code uses ArrayBuffers for each group of values in groupBy, as well

git commit: [SPARK-2529] Clean closures in foreach and foreachPartition.

Repository: spark Updated Branches: refs/heads/master 8529ced35 - eb82abd8e [SPARK-2529] Clean closures in foreach and foreachPartition. Author: Reynold Xin r...@apache.org Closes #1583 from rxin/closureClean and squashes the following commits: 8982fe6 [Reynold Xin] [SPARK-2529] Clean

git commit: [SPARK-2529] Clean closures in foreach and foreachPartition.

Repository: spark Updated Branches: refs/heads/branch-1.0 70109da21 - 797c663ae [SPARK-2529] Clean closures in foreach and foreachPartition. Author: Reynold Xin r...@apache.org Closes #1583 from rxin/closureClean and squashes the following commits: 8982fe6 [Reynold Xin] [SPARK-2529] Clean

git commit: [SPARK-2665] [SQL] Add EqualNS Unit Tests

Repository: spark Updated Branches: refs/heads/master eb82abd8e - 184aa1c6c [SPARK-2665] [SQL] Add EqualNS Unit Tests Hive Supports the operator =, which returns same result with EQUAL(=) operator for non-null operands, but returns TRUE if both are NULL, FALSE if one of the them is NULL.

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 797c663ae - 919c87f26 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/919c87f2 Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 86a5fc071

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 919c87f26 - edbd02fc6 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/edbd02fc Tree:

git commit: [SPARK-2683] unidoc failed because org.apache.spark.util.CallSite uses Java keywords as value names

Repository: spark Updated Branches: refs/heads/master a2715ccd9 - 32bcf9af9 [SPARK-2683] unidoc failed because org.apache.spark.util.CallSite uses Java keywords as value names Renaming `short` to `shortForm` and `long` to `longForm`. JIRA: https://issues.apache.org/jira/browse/SPARK-2683

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.0.2-rc1

Revert [maven-release-plugin] prepare release v1.0.2-rc1 This reverts commit 919c87f26a2655bfd5ae03958915b6804367c1d6. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/01fc6d88 Tree:

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 01fc6d885 - 08f601328 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/08f60132 Tree:

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 08f601328 - 54df1b8c3 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/54df1b8c Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 6053ff1be

[2/2] git commit: [SPARK-2410][SQL] Merging Hive Thrift/JDBC server

[SPARK-2410][SQL] Merging Hive Thrift/JDBC server JIRA issue: - Main: [SPARK-2410](https://issues.apache.org/jira/browse/SPARK-2410) - Related: [SPARK-2678](https://issues.apache.org/jira/browse/SPARK-2678) Cherry picked the Hive Thrift/JDBC server from

[1/2] [SPARK-2410][SQL] Merging Hive Thrift/JDBC server

Repository: spark Updated Branches: refs/heads/master 32bcf9af9 - 06dc0d2c6 http://git-wip-us.apache.org/repos/asf/spark/blob/06dc0d2c/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/server/SparkSQLOperationManager.scala

git commit: [SPARK-2682] Javadoc generated from Scala source code is not in javadoc's index

Repository: spark Updated Branches: refs/heads/master 06dc0d2c6 - a19d8c89d [SPARK-2682] Javadoc generated from Scala source code is not in javadoc's index Add genjavadocSettings back to SparkBuild. It requires #1585 . https://issues.apache.org/jira/browse/SPARK-2682 Author: Yin Huai

git commit: Updated CHANGES.txt

Repository: spark Updated Branches: refs/heads/branch-1.0 54df1b8c3 - 76117baa7 Updated CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/76117baa Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/76117baa

[1/2] git commit: Revert [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 76117baa7 - 4be1dbd82 Revert [maven-release-plugin] prepare for next development iteration This reverts commit 54df1b8c31fa2de5b04ee4a5563706b2664f34f3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.0.2-rc1

Revert [maven-release-plugin] prepare release v1.0.2-rc1 This reverts commit 08f601328ad9e7334ef7deb3a9fff1343a3c4f30. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4be1dbd8 Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [deleted] 6053ff1be

git commit: [SQL]Update HiveMetastoreCatalog.scala

Repository: spark Updated Branches: refs/heads/master a19d8c89d - ab3c6a455 [SQL]Update HiveMetastoreCatalog.scala I think it's better to defined hiveQlTable as a val Author: baishuo(白硕) vc_j...@hotmail.com Closes #1569 from baishuo/patch-1 and squashes the following commits: dc2f895

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 4be1dbd82 - 8fb6f00e1 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8fb6f00e Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 913e3de6d

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 8fb6f00e1 - 03b684253 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/03b68425 Tree:

git commit: [SPARK-2125] Add sort flag and move sort into shuffle implementations

Repository: spark Updated Branches: refs/heads/master ab3c6a455 - 47b6b38ca [SPARK-2125] Add sort flag and move sort into shuffle implementations This patch adds a sort flag into ShuffleDependecy and moves sort into hash shuffle implementation. Moving sort into shuffle implementation can

git commit: [SPARK-1726] [SPARK-2567] Eliminate zombie stages in UI.

Repository: spark Updated Branches: refs/heads/master 47b6b38ca - 37ad3b724 [SPARK-1726] [SPARK-2567] Eliminate zombie stages in UI. Due to problems with when we update runningStages (in DAGScheduler.scala) and how we decide to send a SparkListenerStageCompleted message to SparkListeners,

[2/2] git commit: Revert [SPARK-2410][SQL] Merging Hive Thrift/JDBC server

Revert [SPARK-2410][SQL] Merging Hive Thrift/JDBC server This reverts commit 06dc0d2c6b69c5d59b4d194ced2ac85bfe2e05e2. #1399 is making Jenkins fail. We should investigate and put this back after its passing tests. Author: Michael Armbrust mich...@databricks.com Closes #1594 from

[1/2] Revert [SPARK-2410][SQL] Merging Hive Thrift/JDBC server

Repository: spark Updated Branches: refs/heads/master 37ad3b724 - afd757a24 http://git-wip-us.apache.org/repos/asf/spark/blob/afd757a2/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/server/SparkSQLOperationManager.scala

git commit: Part of [SPARK-2456] Removed some HashMaps from DAGScheduler by storing information in Stage.

Repository: spark Updated Branches: refs/heads/master afd757a24 - 9d8666cac Part of [SPARK-2456] Removed some HashMaps from DAGScheduler by storing information in Stage. This is part of the scheduler cleanup/refactoring effort to make the scheduler code easier to maintain. @kayousterhout

git commit: [SPARK-2659][SQL] Fix division semantics for hive

Repository: spark Updated Branches: refs/heads/master 9d8666cac - 890479123 [SPARK-2659][SQL] Fix division semantics for hive Author: Michael Armbrust mich...@databricks.com Closes #1557 from marmbrus/fixDivision and squashes the following commits: b85077f [Michael Armbrust] Fix unit tests.