[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/1166 [SQL] Break hiveOperators.scala into multiple files. The single file was getting very long (500+ loc). You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46746072 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46746074 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/1167 [SPARK-2227] Support dfs command in SQL. Note that nothing gets printed to the console because we don't properly maintain session state right now. I will have a followup PR that fixes it.

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1167#issuecomment-46746547 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46747248 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46747249 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15982/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1167#issuecomment-46747769 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1167#issuecomment-46747770 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15983/ --- If your project is set up for it, you can

[GitHub] spark pull request: SparkSQL add SkewJoin

2014-06-21 Thread YanjieGao
Github user YanjieGao commented on the pull request: https://github.com/apache/spark/pull/1134#issuecomment-46754360 Hi rxin,I reformat it . Can you give me some suggestions.I will try to make it better. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: Spark SQL basicOperators add Except operator

2014-06-21 Thread YanjieGao
Github user YanjieGao commented on the pull request: https://github.com/apache/spark/pull/1151#issuecomment-46754425 Hi Zongheng, I try it ,and try add code like other operator. I don't know if i want to add this except operator ,do i need to add code or modify code in other scala

[GitHub] spark pull request: Spark SQL add LeftSemiBloomFilterBroadcastJoin

2014-06-21 Thread YanjieGao
Github user YanjieGao commented on the pull request: https://github.com/apache/spark/pull/1127#issuecomment-46754487 Hi Zongheng, I reformat the code .I don't know if that is ok. And i hope you can give me more suggestions . Thanks a lot --- If your project is set up for it, you

[GitHub] spark pull request: Branch 1.0 Add ZLIBCompressionCodec code

2014-06-21 Thread YanjieGao
Github user YanjieGao commented on the pull request: https://github.com/apache/spark/pull/1115#issuecomment-46754558 Hi Srowen , markhamstra . I want to merge this to the master branch.Last time i make a mistake . I resubmit this patch in

[GitHub] spark pull request: Branch 1.0 Add ZLIBCompressionCodec code

2014-06-21 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/1115#issuecomment-46755115 Assuming you have the `apache/spark` repository configured in your git repository as `upstream`, you can checkout your branch for this PR and `git pull --rebase upstream

[GitHub] spark pull request: Branch 1.0 Add ZLIBCompressionCodec code

2014-06-21 Thread YanjieGao
Github user YanjieGao commented on the pull request: https://github.com/apache/spark/pull/1115#issuecomment-46755267 Thanks a lot , I will do it as you said .I once submit it as I fork spark reposity on the web ,and I write the code and run it on intellij .Then i edit the scala

[GitHub] spark pull request: SPARK-1478: Upgrade FlumeInputDStream's FlumeR...

2014-06-21 Thread tmalaska
Github user tmalaska commented on the pull request: https://github.com/apache/spark/pull/566#issuecomment-46755792 I'm going to have to make a new pull request, because I had drop the repo that belonged to this pull request. I will update the ticket with the information when it's

[GitHub] spark pull request: Feat kryo max buffersize

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/735#issuecomment-46759314 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Feat kryo max buffersize

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/735#issuecomment-46759318 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Feat kryo max buffersize

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/735#issuecomment-46760188 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15984/ --- If your project is set up for it, you can

[GitHub] spark pull request: Feat kryo max buffersize

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/735#issuecomment-46760187 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1167#issuecomment-46761293 We do have a circular buffer that holds the command output already. We could probably just add a command to clear it before each command and then optionally use it as

[GitHub] spark pull request: [SPARK-2227] Support dfs command in SQL.

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1167#issuecomment-46761327 This is currently failing for unrelated GraphX MIMA issues. ``` [info] spark-graphx: found 0 potential binary incompatibilities (filtered 17) [error] *

[GitHub] spark pull request: Spark SQL add LeftSemiBloomFilterBroadcastJoin

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1127#discussion_r14051069 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins.scala --- @@ -245,6 +245,73 @@ case class LeftSemiJoinBNL( } }

[GitHub] spark pull request: Spark SQL basicOperators add Except operator

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1151#discussion_r14051137 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -204,3 +204,18 @@ case class ExistingRdd(output:

[GitHub] spark pull request: Spark SQL basicOperators add Except operator

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1151#discussion_r14051147 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -204,3 +204,18 @@ case class ExistingRdd(output:

[GitHub] spark pull request: Spark SQL basicOperators add Except operator

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1151#issuecomment-46761858 Thanks for working on this! A few remaining tasks: - [ ] Add a new logical operator in `basicOperators.scala` in `catalyst/...`. - [ ] Hook that new

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46761937 I'm going to merge this since only MIMA is failing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1166#issuecomment-46761957 Merged into master and 1.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] Break hiveOperators.scala into multiple ...

2014-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/1166 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051239 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala --- @@ -124,4 +128,6 @@ class JoinedRow extends Row {

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051257 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala --- @@ -81,6 +81,10 @@ class JoinedRow extends Row {

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051261 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -25,26 +25,6 @@ import

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051271 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -114,48 +94,27 @@ object HashFilteredJoin extends

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051287 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -29,30 +29,25 @@ import

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051296 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins.scala --- @@ -36,158 +37,211 @@ case object BuildLeft extends BuildSide case

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051297 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins.scala --- @@ -18,6 +18,7 @@ package org.apache.spark.sql.execution

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1147#discussion_r14051302 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins.scala --- @@ -249,12 +297,15 @@ case class LeftSemiJoinBNL( * :: DeveloperApi

[GitHub] spark pull request: [SQL][SPARK-2212]HashJoin(Shuffled)

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1147#issuecomment-46762746 I think it would be much better if this PR just added support for LeftOuter (and maybe RightOuter too?) to HashJoin. --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread tmalaska
GitHub user tmalaska opened a pull request: https://github.com/apache/spark/pull/1168 SPARK-1478.2: Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915 SPARK-1478.2: Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915 You can merge this pull request

[GitHub] spark pull request: SPARK-1478: Upgrade FlumeInputDStream's FlumeR...

2014-06-21 Thread tmalaska
Github user tmalaska commented on the pull request: https://github.com/apache/spark/pull/566#issuecomment-46763419 New Pull request https://github.com/apache/spark/pull/1168 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46763507 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46763617 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46763622 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46763649 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46763650 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15985/ --- If your project is set up for it, you can

[GitHub] spark pull request: spark-ec2: quote command line args

2014-06-21 Thread orikremer
GitHub user orikremer opened a pull request: https://github.com/apache/spark/pull/1169 spark-ec2: quote command line args To preserve quoted command line args (in case options have space in them). You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: spark-ec2: quote command line args

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1169#issuecomment-46763973 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WIP] [SQL] SPARK-1800 Add broadcast hash join...

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1163#discussion_r14051518 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -243,16 +242,25 @@ object HiveMetastoreTypes extends

[GitHub] spark pull request: [SQL] SPARK-1800 Add broadcast hash join opera...

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/734#issuecomment-46764177 Closing in favor of: #1163 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] SPARK-1800 Add broadcast hash join opera...

2014-06-21 Thread marmbrus
Github user marmbrus closed the pull request at: https://github.com/apache/spark/pull/734 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [WIP] [SQL] SPARK-1800 Add broadcast hash join...

2014-06-21 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/1163#discussion_r14051536 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala --- @@ -45,8 +45,8 @@ class Projection(expressions:

[GitHub] spark pull request: spark-ec2: quote command line args

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1169#issuecomment-46764293 Jenkins, test this please. Thanks this LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46764347 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46764340 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46764649 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46764653 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [WIP] [SQL] SPARK-1800 Add broadcast hash join...

2014-06-21 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1163#issuecomment-46764715 Regarding testing we will probably want to pull all of our various join tests out into a separate test suite that can be run with various options turned on an off so we

[GitHub] spark pull request: spark-ec2: quote command line args

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1169#issuecomment-46765273 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: spark-ec2: quote command line args

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1169#issuecomment-46765274 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15986/ --- If your

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46765270 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765275 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15987/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46765330 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46765328 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46765353 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765537 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15988/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765536 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765859 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765864 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765886 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46765887 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15990/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/1170 SPARK-1996. Remove use of special Maven repo for Akka Just following up Matei's suggestion to remove the Akka repo references. Builds and the audit-release script appear OK. You can merge this pull

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766169 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766174 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766197 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15991/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/1171 SPARK-1675. Make clear whether computePrincipalComponents requires centered data Just closing out this small JIRA, resolving with a comment change. You can merge this pull request into a Git

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766196 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766279 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766302 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766283 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766303 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15992/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46766392 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46766386 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46766437 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766456 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46766447 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766462 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766505 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1996. Remove use of special Maven repo f...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1170#issuecomment-46766513 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46766508 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46766509 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766514 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1675. Make clear whether computePrincipa...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1171#issuecomment-46766504 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1949. Servlet 2.5 vs 3.0 conflict in SBT...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/906#issuecomment-46766516 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1777][WIP] Prevent OOMs from single par...

2014-06-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1165#issuecomment-46766515 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-2124] Move aggregation into shuffle imp...

2014-06-21 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/1064#discussion_r14051999 --- Diff: core/src/main/scala/org/apache/spark/shuffle/hash/HashShuffleReader.scala --- @@ -31,10 +31,24 @@ class HashShuffleReader[K, C](

[GitHub] spark pull request: [SPARK-2124] Move aggregation into shuffle imp...

2014-06-21 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/1064#discussion_r14052024 --- Diff: core/src/test/scala/org/apache/spark/ShuffleSuite.scala --- @@ -78,8 +81,11 @@ class ShuffleSuite extends FunSuite with Matchers with

[GitHub] spark pull request: [SPARK-2124] Move aggregation into shuffle imp...

2014-06-21 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/1064#discussion_r14052020 --- Diff: core/src/test/scala/org/apache/spark/ShuffleSuite.scala --- @@ -56,8 +56,11 @@ class ShuffleSuite extends FunSuite with Matchers with

[GitHub] spark pull request: [SPARK-2124] Move aggregation into shuffle imp...

2014-06-21 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1064#issuecomment-46767244 Hey Saisai, I noticed one thing that got lost in the move, which is the use of InterruptibleIterator. We need to bring that back to allow cancellation of reduce tasks.

[GitHub] spark pull request: SPARK-1478.2: Upgrade FlumeInputDStream's Flum...

2014-06-21 Thread tmalaska
Github user tmalaska commented on the pull request: https://github.com/apache/spark/pull/1168#issuecomment-46767307 Thanks tdas I messed that one. I just updated. It should be good now. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-1112, 2156] (1.0 edition) Use correct a...

2014-06-21 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/1172#issuecomment-46767349 @mengxr - do you mind reviewing this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

  1   2   >