[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948112#comment-15948112 ] Yufei Gu commented on YARN-5654: Great! Thanks [~rkanter] for the review and commit! > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Fix For: 3.0.0-alpha3 > > Attachments: YARN-5654.002.patch, YARN-5654.003.patch, > YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948110#comment-15948110 ] Hudson commented on YARN-5654: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11493 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11493/]) YARN-5654. Not be able to run SLS with FairScheduler (yufeigu via (rkanter: rev 6a5516c2381f107d96b8326939514de3c6e53d3d) * (edit) hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/appmaster/TestAMSimulator.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/SLSRunner.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/utils/SLSUtils.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/web/SLSWebApp.java * (add) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/Tracker.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SchedulerWrapper.java * (edit) hadoop-tools/hadoop-sls/src/test/java/org/apache/hadoop/yarn/sls/nodemanager/TestNMSimulator.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/appmaster/AMSimulator.java * (add) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSFairScheduler.java * (delete) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/ResourceSchedulerWrapper.java * (edit) hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SchedulerMetrics.java > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Fix For: 3.0.0-alpha3 > > Attachments: YARN-5654.002.patch, YARN-5654.003.patch, > YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948070#comment-15948070 ] Robert Kanter commented on YARN-5654: - +1 > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Attachments: YARN-5654.002.patch, YARN-5654.003.patch, > YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[
https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940962#comment-15940962
]
Hadoop QA commented on YARN-5654:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
21s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 2 new or modified test
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m
16s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
16s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
15s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
19s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
15s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 11s{color} | {color:orange} hadoop-tools/hadoop-sls: The patch generated 5
new + 94 unchanged - 133 fixed = 99 total (was 227) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
53s{color} | {color:green} hadoop-sls in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 19m 44s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:a9ad5d6 |
| JIRA Issue | YARN-5654 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12860423/YARN-5654.003.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux 86815f289c28 3.13.0-107-generic #154-Ubuntu SMP Tue Dec 20
09:57:27 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 52b0060 |
| Default Java | 1.8.0_121 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/15379/artifact/patchprocess/diff-checkstyle-hadoop-tools_hadoop-sls.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/15379/testReport/ |
| modules | C: hadoop-tools/hadoop-sls U: hadoop-tools/hadoop-sls |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/15379/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Not be able to run SLS with FairScheduler
> -
>
> Key: YARN-5654
> URL: https://issues.apache.org/jira/browse/YARN-5654
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Wangda Tan
>Assignee: Yufei Gu
> Attachments: YARN-5654.002.patch, YARN-5654.003.patch,
> YARN-5654.1.patch
>
>
> With the config:
>
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[
https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940934#comment-15940934
]
Yufei Gu commented on YARN-5654:
Uploaded patch v3.
# Fix the style issue
# Extract duplicate code from {{SLSCapacityScheduler}} and {{SLSFairScheduler}}
to {{SchedulerMetrics}} and a new class {{Tracker}}.
# Test both CS and FS with an example configuration. Both works well except the
FS issue I mentioned in last comment, which I am gonna to do it in followup
JIRAs.
> Not be able to run SLS with FairScheduler
> -
>
> Key: YARN-5654
> URL: https://issues.apache.org/jira/browse/YARN-5654
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Wangda Tan
>Assignee: Yufei Gu
> Attachments: YARN-5654.002.patch, YARN-5654.003.patch,
> YARN-5654.1.patch
>
>
> With the config:
> https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs
> And data:
> https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data
> Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run.
> It reports NPE from RMAppAttemptImpl
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[
https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939463#comment-15939463
]
Hadoop QA commented on YARN-5654:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 16m
10s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 2 new or modified test
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 12m
29s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
18s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
15s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
28s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
15s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
15s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 29s{color} | {color:orange} hadoop-tools/hadoop-sls: The patch generated 30
new + 96 unchanged - 84 fixed = 126 total (was 180) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
11s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 8 line(s) with tabs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
54s{color} | {color:green} hadoop-sls in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
18s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 35m 1s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:a9ad5d6 |
| JIRA Issue | YARN-5654 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12860244/YARN-5654.002.patch |
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux 27c2b52aa132 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12
13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 1280155 |
| Default Java | 1.8.0_121 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-YARN-Build/15369/artifact/patchprocess/diff-checkstyle-hadoop-tools_hadoop-sls.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-YARN-Build/15369/artifact/patchprocess/whitespace-tabs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/15369/testReport/ |
| modules | C: hadoop-tools/hadoop-sls U: hadoop-tools/hadoop-sls |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/15369/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Not be able to run SLS with FairScheduler
> -
>
> Key: YARN-5654
> URL: https://issues.apache.org/jira/browse/YARN-5654
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Wangda Tan
>Assignee: Yufei Gu
>
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[
https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939440#comment-15939440
]
Yufei Gu commented on YARN-5654:
Uploaded patch v2.
# Remove class {{ResourceSchedulerWrapper}}. We realize that better to inherit
Scheduler Wrapper from the Real scheduler class instead of
AbstractYarnScheduler after an offline discussion with [~rkanter], so that any
public interface changes of FairScheduler could reflect into the scheduler
wrapper. CapacityScheduler did in that way for a long time. The only downside
is we don't automatically have the wrapper for FifoScheduler.
# There are lots of duplicated code in {{SLSCapacityScheduler}} and
{{SLSFairScheduler}}(used to be in {{ResourceSchedulerWrapper}}). Most of them
are related to scheduler metrics. Make more sense to move them into
{{SchedulerMetrics}}. This not only makes extension of SLSFairScheduler and
SLSCapacityScheduler easier, e.g., right now both SLS scheduler wrapper extend
functions {{allocate()}} and {{handle()}}, we need to extend more functions
potentially. This also makes writing {{SLSFifoScheduler}} easier. File
YARN-6383 for FifoScheduler.
# Parameterize unit tests TestAMSimulator and TestNMSimulator so that they can
support both capacity scheduler and fair scheduler.
# This patch make FairScheduler in SLS work generally. But there are still some
bugs to fix, e.g. the queue metrics and cluster metrics doesn't work well. It
is too much to put them in this jira. I will file followup jira for them.
> Not be able to run SLS with FairScheduler
> -
>
> Key: YARN-5654
> URL: https://issues.apache.org/jira/browse/YARN-5654
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Wangda Tan
>Assignee: Yufei Gu
> Attachments: YARN-5654.002.patch, YARN-5654.1.patch
>
>
> With the config:
> https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs
> And data:
> https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data
> Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run.
> It reports NPE from RMAppAttemptImpl
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856886#comment-15856886 ] Yufei Gu commented on YARN-5654: [~wangda], sure. I'll look into this soon. > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Attachments: YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856863#comment-15856863 ] Wangda Tan commented on YARN-5654: -- [~yufeigu], It is still assigned to you :). I think I'm not the best person to work on this fix, since I have limited experiences to work on FS code base. If you have interests to do this, please continue and feel free to make any changes to the attached preliminary fix. Thanks, > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Attachments: YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856852#comment-15856852 ] Yufei Gu commented on YARN-5654: Hi [~wangda], sorry for delay reply. I have the interests to work on this. But since you've uploaded the patch, feel free to assign to you. I can try to do the review, but not the best person to do that. And you are free to assign back to me if any further work needed and you don't want to continue. Thanks. > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > Attachments: YARN-5654.1.patch > > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576788#comment-15576788 ] Wangda Tan commented on YARN-5654: -- Hi [~yufeigu], I have just finished the FS patch for SLS before realizing this patch is already assigned to you, sorry for that. Uploaded ver.1 patch, if you have interests/bandwidth to move on, please feel free keeping assign this to you and I can help with review. > Not be able to run SLS with FairScheduler > - > > Key: YARN-5654 > URL: https://issues.apache.org/jira/browse/YARN-5654 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Wangda Tan >Assignee: Yufei Gu > > With the config: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/configs/hadoop-conf-fs > And data: > https://github.com/leftnoteasy/yarn_application_synthesizer/tree/master/data/scheduler-load-test-data > Capacity Scheduler runs fine, but Fair Scheduler cannot be successfully run. > It reports NPE from RMAppAttemptImpl -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
