[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-13 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62945941 Good catch. The jar won't be there unless `-Pyarn` is provided. I'll fix this shortly. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-13 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62955440 Alright the hot fix is merged. Thanks for reporting. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62799360 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62799474 Ok, I merge into master and 1.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62801902 Okay, you merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62833490 I ran the `make-distribution.sh` script and it complained about being unable to find the YARN shuffle jar: ``` [...] [INFO]

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-12 Thread arahuja
Github user arahuja commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62834492 I had that as well when I did provide -Pyarn to `make-distribution.sh` --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62500148 [Test build #23191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23191/consoleFull) for PR 3147 at commit

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62504754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62504749 [Test build #23191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23191/consoleFull) for PR 3147 at commit

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-08 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050632 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20023234 --- Diff: network/common/pom.xml --- @@ -41,12 +41,12 @@ groupIdio.netty/groupId artifactIdnetty-all/artifactId /dependency

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20023680 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62180858 [Test build #23056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23056/consoleFull) for PR 3147 at commit

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20024208 --- Diff: network/common/pom.xml --- @@ -41,12 +41,12 @@ groupIdio.netty/groupId artifactIdnetty-all/artifactId /dependency

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62193940 [Test build #23056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23056/consoleFull) for PR 3147 at commit

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62193959 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050454 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050522 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050530 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050532 --- Diff: make-distribution.sh --- @@ -181,6 +181,7 @@ echo Spark $VERSION$GITREVSTRING built for Hadoop $SPARK_HADOOP_VERSION $DI # Copy jars cp

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r20050539 --- Diff: project/SparkBuild.scala --- @@ -38,12 +38,12 @@ object BuildCommons { streaming-flume, streaming-kafka, streaming-mqtt,

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62249300 Hey Andrew - this looks good. I added some comment, all were regarding how we name the produced jar. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62097132 @pwendell Can you review the changes here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62105194 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3147#issuecomment-62105186 [Test build #23037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23037/consoleFull) for PR 3147 at commit

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-06 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r19996897 --- Diff: network/common/pom.xml --- @@ -41,12 +41,12 @@ groupIdio.netty/groupId artifactIdnetty-all/artifactId /dependency

[GitHub] spark pull request: [SPARK-4281][Build] Package Yarn shuffle servi...

2014-11-06 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3147#discussion_r19996948 --- Diff: network/yarn/pom.xml --- @@ -54,5 +54,38 @@ build outputDirectorytarget/scala-${scala.binary.version}/classes/outputDirectory