[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-16 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42451101 @tgravescs yes the `akka` thing is intentional. Anything else with this? I'd like to get it merged to allow us to cut another RC. --- If your project is set up for it, y

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-16 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42456933 Its ready to go. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-14 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42422825 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42423133 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42423123 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42427401 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/649 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42427404 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14773/ --- If your project

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42385464 build failures being fixed by pr 673. We should rekick jenkins when that is integrated. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12358286 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42384111 @pwendell I noticed that the akka. settings can't be set in the properties file for spark-submit. I assume that is ok but wanted to mention it. --- If your project is s

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42384470 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14752/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42384276 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42455743 LGTM from my side --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42384268 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42384469 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12352939 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12352794 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42366250 @tgravescs do you have more work on this or is it ready? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12343291 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12340904 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logging

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12340622 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logging

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-06 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12339942 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12308577 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Logging

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12308538 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logging

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42258745 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42258746 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14691/ --- If your project

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42257151 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42257094 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12306438 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Logging

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12305563 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12304125 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12299735 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,18 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12299536 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12299239 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Logg

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42237827 I'll look at changing it to do just the security configs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42227073 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14672/ --- If your project

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-42227072 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12294097 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,18 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12294032 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -85,25 +93,25 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12293838 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,18 @@ trait ExecutorRunnableUtil extends Log

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/649#discussion_r12293695 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala --- @@ -56,10 +56,18 @@ trait ExecutorRunnableUtil extends Loggi

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-4335 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/649#issuecomment-4313 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1569 Spark on Yarn, authentication broke...

2014-05-05 Thread tgravescs
GitHub user tgravescs opened a pull request: https://github.com/apache/spark/pull/649 SPARK-1569 Spark on Yarn, authentication broken by pr299 Pass the configs as java options since the executor needs to know before it registers whether to create the connection using authentication