spark git commit: [SPARK-4307] Initialize FileDescriptor lazily in FileRegion.

Repository: spark Updated Branches: refs/heads/master 65083e93d -> ef29a9a9a [SPARK-4307] Initialize FileDescriptor lazily in FileRegion. Netty's DefaultFileRegion requires a FileDescriptor in its constructor, which means we need to have a opened file handle. In super large workloads, this c

spark git commit: [SPARK-4307] Initialize FileDescriptor lazily in FileRegion.

Repository: spark Updated Branches: refs/heads/branch-1.2 df8242c9b -> e9d009dc3 [SPARK-4307] Initialize FileDescriptor lazily in FileRegion. Netty's DefaultFileRegion requires a FileDescriptor in its constructor, which means we need to have a opened file handle. In super large workloads, thi

spark git commit: [SPARK-4295][External]Fix exception in SparkSinkSuite

Repository: spark Updated Branches: refs/heads/master ef29a9a9a -> f8811a569 [SPARK-4295][External]Fix exception in SparkSinkSuite Handle exception in SparkSinkSuite, please refer to [SPARK-4295] Author: maji2014 Closes #3177 from maji2014/spark-4295 and squashes the following commits: 312

spark git commit: [SPARK-4295][External]Fix exception in SparkSinkSuite

Repository: spark Updated Branches: refs/heads/branch-1.2 e9d009dc3 -> fe8a1cd29 [SPARK-4295][External]Fix exception in SparkSinkSuite Handle exception in SparkSinkSuite, please refer to [SPARK-4295] Author: maji2014 Closes #3177 from maji2014/spark-4295 and squashes the following commits:

spark git commit: [SPARK-4295][External]Fix exception in SparkSinkSuite

Repository: spark Updated Branches: refs/heads/branch-1.1 b2cb357d7 -> bf867c317 [SPARK-4295][External]Fix exception in SparkSinkSuite Handle exception in SparkSinkSuite, please refer to [SPARK-4295] Author: maji2014 Closes #3177 from maji2014/spark-4295 and squashes the following commits:

spark git commit: [SPARK-2492][Streaming] kafkaReceiver minor changes to align with Kafka 0.8

Repository: spark Updated Branches: refs/heads/branch-1.2 fe8a1cd29 -> 7710b7156 [SPARK-2492][Streaming] kafkaReceiver minor changes to align with Kafka 0.8 Update the KafkaReceiver's behavior when auto.offset.reset is set. In Kafka 0.8, `auto.offset.reset` is a hint for out-range offset to s

spark git commit: [SPARK-2492][Streaming] kafkaReceiver minor changes to align with Kafka 0.8

Repository: spark Updated Branches: refs/heads/master f8811a569 -> c8850a3d6 [SPARK-2492][Streaming] kafkaReceiver minor changes to align with Kafka 0.8 Update the KafkaReceiver's behavior when auto.offset.reset is set. In Kafka 0.8, `auto.offset.reset` is a hint for out-range offset to seek

spark git commit: [Streaming][Minor]Replace some 'if-else' in Clock

Repository: spark Updated Branches: refs/heads/master c8850a3d6 -> 6e03de304 [Streaming][Minor]Replace some 'if-else' in Clock Replace some 'if-else' statement by math.min and math.max in Clock.scala Author: huangzhaowei Closes #3088 from SaintBacchus/StreamingClock and squashes the followi

spark git commit: [Streaming][Minor]Replace some 'if-else' in Clock

Repository: spark Updated Branches: refs/heads/branch-1.2 7710b7156 -> cc1f3a0d6 [Streaming][Minor]Replace some 'if-else' in Clock Replace some 'if-else' statement by math.min and math.max in Clock.scala Author: huangzhaowei Closes #3088 from SaintBacchus/StreamingClock and squashes the fol

spark git commit: SPARK-1830 Deploy failover, Make Persistence engine and LeaderAgent Pluggable

Repository: spark Updated Branches: refs/heads/master 6e03de304 -> deefd9d73 SPARK-1830 Deploy failover, Make Persistence engine and LeaderAgent Pluggable Author: Prashant Sharma Closes #771 from ScrapCodes/deploy-failover-pluggable and squashes the following commits: 29ba440 [Prashant Sha

spark git commit: SPARK-4305 [BUILD] yarn-alpha profile won't build due to network/yarn module

Repository: spark Updated Branches: refs/heads/master deefd9d73 -> f820b563d SPARK-4305 [BUILD] yarn-alpha profile won't build due to network/yarn module SPARK-3797 introduced the `network/yarn` module, but its YARN code depends on YARN APIs not present in older versions covered by the `yarn-

spark git commit: SPARK-4305 [BUILD] yarn-alpha profile won't build due to network/yarn module

Repository: spark Updated Branches: refs/heads/branch-1.2 cc1f3a0d6 -> 8f7e80f30 SPARK-4305 [BUILD] yarn-alpha profile won't build due to network/yarn module SPARK-3797 introduced the `network/yarn` module, but its YARN code depends on YARN APIs not present in older versions covered by the `y

spark git commit: [SPARK-4282][YARN] Stopping flag in YarnClientSchedulerBackend should be volatile

Repository: spark Updated Branches: refs/heads/branch-1.2 8f7e80f30 -> ec0d89bc9 [SPARK-4282][YARN] Stopping flag in YarnClientSchedulerBackend should be volatile In YarnClientSchedulerBackend, a variable "stopping" is used as a flag and it's accessed by some threads so it should be volatile

spark git commit: [SPARK-4282][YARN] Stopping flag in YarnClientSchedulerBackend should be volatile

Repository: spark Updated Branches: refs/heads/master f820b563d -> 7f3718842 [SPARK-4282][YARN] Stopping flag in YarnClientSchedulerBackend should be volatile In YarnClientSchedulerBackend, a variable "stopping" is used as a flag and it's accessed by some threads so it should be volatile. A

spark git commit: SPARK-2269 Refactor mesos scheduler resourceOffers and add unit test

Repository: spark Updated Branches: refs/heads/master 7f3718842 -> a878660d2 SPARK-2269 Refactor mesos scheduler resourceOffers and add unit test Author: Timothy Chen Closes #1487 from tnachen/resource_offer_refactor and squashes the following commits: 4ea5dec [Timothy Chen] Rebase from ma

spark git commit: SPARK-2269 Refactor mesos scheduler resourceOffers and add unit test

Repository: spark Updated Branches: refs/heads/branch-1.2 ec0d89bc9 -> 6a7ddf4ce SPARK-2269 Refactor mesos scheduler resourceOffers and add unit test Author: Timothy Chen Closes #1487 from tnachen/resource_offer_refactor and squashes the following commits: 4ea5dec [Timothy Chen] Rebase fro

spark git commit: Update CHANGES.txt

Repository: spark Updated Branches: refs/heads/branch-1.1 bf867c317 -> 131c62672 Update CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/131c6267 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/131c6267

spark git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.1 f3e62ffa4 -> 5c0032a47 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5c0032a4 Tree: http://git-wip-u

spark git commit: [maven-release-plugin] prepare release v1.1.1-rc1

Repository: spark Updated Branches: refs/heads/branch-1.1 131c62672 -> f3e62ffa4 [maven-release-plugin] prepare release v1.1.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f3e62ffa Tree: http://git-wip-us.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.1.1-rc1 [created] 490ffd35a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [Release] Log build output for each distribution

Repository: spark Updated Branches: refs/heads/master a878660d2 -> 2ddb1415e [Release] Log build output for each distribution Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2ddb1415 Tree: http://git-wip-us.apache.org/repo

spark git commit: [Release] Log build output for each distribution

Repository: spark Updated Branches: refs/heads/branch-1.2 6a7ddf4ce -> 307b69d73 [Release] Log build output for each distribution Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/307b69d7 Tree: http://git-wip-us.apache.org/

[7/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/pom.xml -- diff --git a/pom.xml b/pom.xml index 4e0cd6c..7bbde31 100644 --- a/pom.xml +++ b/pom.xml @@ -97,30 +97,26 @@ sql/catalyst sql/core sql/hive -r

[2/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/src/main/scala/org/apache/spar

[8/8] spark git commit: Support cross building for Scala 2.11

Support cross building for Scala 2.11 Let's give this another go using a version of Hive that shades its JLine dependency. Author: Prashant Sharma Author: Patrick Wendell Closes #3159 from pwendell/scala-2.11-prashant and squashes the following commits: e93aa3e [Patrick Wendell] Restoring -

[3/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala b/repl/scala-2.1

[4/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/scala-2

[6/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/scala-2

[5/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.sca

[1/8] spark git commit: Support cross building for Scala 2.11

Repository: spark Updated Branches: refs/heads/branch-1.2 307b69d73 -> 12f56334b http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.scala -- diff --git a/re

[3/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala -- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala b/repl/scala-2.1

[2/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/src/main/scala/org/apache/spar

[4/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/scala-2

[8/8] spark git commit: Support cross building for Scala 2.11

Support cross building for Scala 2.11 Let's give this another go using a version of Hive that shades its JLine dependency. Author: Prashant Sharma Author: Patrick Wendell Closes #3159 from pwendell/scala-2.11-prashant and squashes the following commits: e93aa3e [Patrick Wendell] Restoring -

[6/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkIMain.scala b/repl/scala-2

[7/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/pom.xml -- diff --git a/pom.xml b/pom.xml index 4e0cd6c..7bbde31 100644 --- a/pom.xml +++ b/pom.xml @@ -97,30 +97,26 @@ sql/catalyst sql/core sql/hive -r

[1/8] spark git commit: Support cross building for Scala 2.11

Repository: spark Updated Branches: refs/heads/master 2ddb1415e -> daaca14c1 http://git-wip-us.apache.org/repos/asf/spark/blob/daaca14c/repl/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.scala -- diff --git a/repl/s

[5/8] spark git commit: Support cross building for Scala 2.11

http://git-wip-us.apache.org/repos/asf/spark/blob/12f56334/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.scala -- diff --git a/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkMemberHandlers.sca

spark git commit: [MLLIB] SPARK-4347: Reducing GradientBoostingSuite run time.

Repository: spark Updated Branches: refs/heads/master daaca14c1 -> 2ef016b13 [MLLIB] SPARK-4347: Reducing GradientBoostingSuite run time. Before: [info] GradientBoostingSuite: [info] - Regression with continuous features: SquaredError (22 seconds, 115 milliseconds) [info] - Regression with co

spark git commit: [MLLIB] SPARK-4347: Reducing GradientBoostingSuite run time.

Repository: spark Updated Branches: refs/heads/branch-1.2 12f56334b -> c9bb5e459 [MLLIB] SPARK-4347: Reducing GradientBoostingSuite run time. Before: [info] GradientBoostingSuite: [info] - Regression with continuous features: SquaredError (22 seconds, 115 milliseconds) [info] - Regression wit

spark git commit: [SPARK-3936] Add aggregateMessages, which supersedes mapReduceTriplets

Repository: spark Updated Branches: refs/heads/master 2ef016b13 -> faeb41de2 [SPARK-3936] Add aggregateMessages, which supersedes mapReduceTriplets aggregateMessages enables neighborhood computation similarly to mapReduceTriplets, but it introduces two API improvements: 1. Messages are sent

spark git commit: [SPARK-3936] Add aggregateMessages, which supersedes mapReduceTriplets

Repository: spark Updated Branches: refs/heads/branch-1.2 c9bb5e459 -> 4a4cc7e91 [SPARK-3936] Add aggregateMessages, which supersedes mapReduceTriplets aggregateMessages enables neighborhood computation similarly to mapReduceTriplets, but it introduces two API improvements: 1. Messages are s