[jira] [Commented] (YARN-893) Capacity scheduler allocates vcores to containers but does not report it in headroom
[ https://issues.apache.org/jira/browse/YARN-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308705#comment-14308705 ] Arun C Murthy commented on YARN-893: [~kj-ki] [~ozawa] - the {{DefaultResourceCalculator}} is meant to not use vcores by design - if vcores is desired, one should use the {{DominantResourceCalculator}}. Makes sense? Capacity scheduler allocates vcores to containers but does not report it in headroom Key: YARN-893 URL: https://issues.apache.org/jira/browse/YARN-893 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.3.0 Reporter: Bikas Saha Assignee: Kenji Kikushima Attachments: YARN-893-2.patch, YARN-893.patch In non-DRF mode, it reports 0 vcores in the headroom but it allocates 1 vcore to containers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-893) Capacity scheduler allocates vcores to containers but does not report it in headroom
[ https://issues.apache.org/jira/browse/YARN-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308727#comment-14308727 ] Tsuyoshi OZAWA commented on YARN-893: - Make sense to me. Closing this as invalid one. Capacity scheduler allocates vcores to containers but does not report it in headroom Key: YARN-893 URL: https://issues.apache.org/jira/browse/YARN-893 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.3.0 Reporter: Bikas Saha Assignee: Kenji Kikushima Attachments: YARN-893-2.patch, YARN-893.patch In non-DRF mode, it reports 0 vcores in the headroom but it allocates 1 vcore to containers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-893) Capacity scheduler allocates vcores to containers but does not report it in headroom
[ https://issues.apache.org/jira/browse/YARN-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998657#comment-13998657 ] Tsuyoshi OZAWA commented on YARN-893: - Thanks for updating a patch, [~kj-ki]. It looks very cleaner. Great job. One additional point: Can we add unit tests for utility methods in DefaultResourceCalculator? Capacity scheduler allocates vcores to containers but does not report it in headroom Key: YARN-893 URL: https://issues.apache.org/jira/browse/YARN-893 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.3.0 Reporter: Bikas Saha Assignee: Kenji Kikushima Attachments: YARN-893-2.patch, YARN-893.patch In non-DRF mode, it reports 0 vcores in the headroom but it allocates 1 vcore to containers. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-893) Capacity scheduler allocates vcores to containers but does not report it in headroom
[ https://issues.apache.org/jira/browse/YARN-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13925479#comment-13925479 ] Hadoop QA commented on YARN-893: {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12633633/YARN-893.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.TestProportionalCapacityPreemptionPolicy org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestApplicationLimits org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestParentQueue {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/3308//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3308//console This message is automatically generated. Capacity scheduler allocates vcores to containers but does not report it in headroom Key: YARN-893 URL: https://issues.apache.org/jira/browse/YARN-893 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.3.0 Reporter: Bikas Saha Assignee: Kenji Kikushima Attachments: YARN-893.patch In non-DRF mode, it reports 0 vcores in the headroom but it allocates 1 vcore to containers. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-893) Capacity scheduler allocates vcores to containers but does not report it in headroom
[ https://issues.apache.org/jira/browse/YARN-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13929806#comment-13929806 ] Tsuyoshi OZAWA commented on YARN-893: - Hi [~kj-ki], thank you for taking this JIRA. {code} @Test(timeout = 300) {code} Before doing this, we should change timeout to smaller value, because it can blocks Apache's Jenkins server for a long time. And can you fix the test failures? The test failures looks CapacityScheduler-related. Capacity scheduler allocates vcores to containers but does not report it in headroom Key: YARN-893 URL: https://issues.apache.org/jira/browse/YARN-893 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.3.0 Reporter: Bikas Saha Assignee: Kenji Kikushima Attachments: YARN-893.patch In non-DRF mode, it reports 0 vcores in the headroom but it allocates 1 vcore to containers. -- This message was sent by Atlassian JIRA (v6.2#6252)