[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-26 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115695061 thanks @vanzin , merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115306897 [Test build #35790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35790/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115306204 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread sujkh85
Github user sujkh85 commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115306345 NAVER - http://www.naver.com/ su...@naver.com 님께 보내신 메일 Re: [spark] [SPARK-8302] Support

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115306590 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115306610 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115359051 [Test build #35790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35790/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-115359107 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-16 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32537855 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-16 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32537737 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-16 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112483488 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32435583 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32436913 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32436071 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112134991 The other part that needs to get added is the user docs in running-on-yarn.md -- I suppose that can wait till we agree on the approach. --- If your project is set up

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112163696 I think our comments about user config crossed each other ... anyhow: No, I was actually replying to you. :-) It's just that github doesn't understand the

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112171261 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112171301 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112172333 [Test build #34958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34958/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112124416 I just left some minor comments on the code. I like the simplicity of this over some more complicated proposals. The only thing I'm still thinking about is how to best

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32441036 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112133704 I'm also not sure where to document this; while it's obviously a user config, it's not something I expect users to fiddle with; this is something that admins would set

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32440729 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112137395 I think our comments about user config crossed each other ... anyhow: I'm also not sure where to document this; while it's obviously a user config, it's not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112203598 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-15 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-112203530 [Test build #34958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34958/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-14 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111805082 LGTM, pending any further comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-12 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32303953 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-12 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32328620 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,6 +1187,29 @@ object Client extends Logging {

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32209657 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1179,8 +1182,35 @@ object Client extends Logging { * Add the given

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6752#discussion_r32243713 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1179,8 +1182,35 @@ object Client extends Logging { * Add the given path

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111229937 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111230065 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111230349 [Test build #34702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34702/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111260146 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111260133 [Test build #34702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34702/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110960720 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110960705 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110963330 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110963344 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110963372 [Test build #34652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34652/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/6752 [SPARK-8302] Support heterogeneous cluster install paths on YARN. Some users have Hadoop installations on different paths across their cluster. Currently, that makes it hard to set up some

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110960407 note: check comments on SPARK-8302 for an alternative approach that I thought was too intrusive. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110961378 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110961375 [Test build #34648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34648/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110961234 [Test build #34648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34648/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111004475 [Test build #34658 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34658/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-111004484 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110981568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110994197 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110994233 [Test build #34658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34658/consoleFull) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110994194 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110981554 [Test build #34652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34652/console) for PR 6752 at commit

[GitHub] spark pull request: [SPARK-8302] Support heterogeneous cluster ins...

2015-06-10 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6752#issuecomment-110993510 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not