[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-11-30 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240788#comment-17240788 ] Gergely Pollak commented on YARN-10425: --- [~aajisaka] thank you for spotting this, I've left a

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240831#comment-17240831 ] Hadoop QA commented on YARN-10169: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9883) Reshape SchedulerHealth class

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240603#comment-17240603 ] Hadoop QA commented on YARN-9883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10473) Implement application group manager and related API

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240612#comment-17240612 ] Hadoop QA commented on YARN-10473: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10473) Implement application group manager and related API

2020-11-30 Thread jialei weng (Jira)
[ https://issues.apache.org/jira/browse/YARN-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-10473: --- Attachment: Implement-application-group-feature for hadoop 2.9.2.patch > Implement application group

[jira] [Commented] (YARN-10473) Implement application group manager and related API

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240618#comment-17240618 ] Hadoop QA commented on YARN-10473: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10431) [Umbrella] Job group management

2020-11-30 Thread jialei weng (Jira)
[ https://issues.apache.org/jira/browse/YARN-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240613#comment-17240613 ] jialei weng commented on YARN-10431: [~epayne], this design is a inner yarn level to organize

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240742#comment-17240742 ] zhuqi commented on YARN-10169: -- [~leftnoteasy] [~sunil.gov...@gmail.com] [~BilwaST] [~prabhujoseph] I have

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240765#comment-17240765 ] zhuqi commented on YARN-10169: -- Fix testComplexValidateAbsoluteResourceConfig not trigger mixed case in

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240850#comment-17240850 ] Hadoop QA commented on YARN-10169: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-11-30 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10504: - Description: To allow the possibility to flexibly create queues in Capacity Scheduler a weight

[jira] [Created] (YARN-10505) Extend the maximum-capacity property to react to weight mode changes

2020-11-30 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10505: Summary: Extend the maximum-capacity property to react to weight mode changes Key: YARN-10505 URL: https://issues.apache.org/jira/browse/YARN-10505 Project: Hadoop

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-11-30 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240870#comment-17240870 ] Benjamin Teke commented on YARN-10496: -- Added subtasks for approach#1. > [Umbrella] Support

[jira] [Created] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-11-30 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10506: Summary: Update queue creation logic to use weight mode and allow the flexible static/dynamic creation Key: YARN-10506 URL: https://issues.apache.org/jira/browse/YARN-10506

[jira] [Created] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-11-30 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10504: Summary: Implement weight mode in Capacity Scheduler Key: YARN-10504 URL: https://issues.apache.org/jira/browse/YARN-10504 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-11-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-001.patch > Add the capability to fs2cs to write the converted placement

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-11-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-002.patch > Add the capability to fs2cs to write the converted placement

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240963#comment-17240963 ] Hadoop QA commented on YARN-10507: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10431) [Umbrella] Job group management

2020-11-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240906#comment-17240906 ] Eric Payne commented on YARN-10431: --- [~wjlei], thank you for your reply. bq. this design is a inner

[jira] [Created] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-11-30 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10507: --- Summary: Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml Key: YARN-10507 URL: https://issues.apache.org/jira/browse/YARN-10507

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-11-30 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241017#comment-17241017 ] Szilard Nemeth commented on YARN-10278: --- Hi [~epayne],  Sorry for the late response. OK, got it.

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-11-30 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10278: -- Attachment: YARN-10278.002.patch > CapacityScheduler test framework >

[jira] [Comment Edited] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-11-30 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241017#comment-17241017 ] Szilard Nemeth edited comment on YARN-10278 at 11/30/20, 8:18 PM: -- Hi

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with more resourceTypes.

2020-11-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10503: -- Fix Version/s: (was: 3.4.1) (was: 3.3.1) Target Version/s: 3.3.1,

[jira] [Updated] (YARN-10508) Protobuf Mesage Incompatibility Detector

2020-11-30 Thread junwen yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] junwen yang updated YARN-10508: --- Description: Regarding the issue YARN-5632 caused by the incompatibility of protobuf message, we

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-11-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241118#comment-17241118 ] Eric Payne commented on YARN-10504: --- [~bteke], does the Queue Priorities feature (YARN-5864) meet your

[jira] [Updated] (YARN-10508) Protobuf Mesage Incompatibility Detector

2020-11-30 Thread junwen yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] junwen yang updated YARN-10508: --- Attachment: yarn_proto_incompatibility.txt > Protobuf Mesage Incompatibility Detector >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-11-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241173#comment-17241173 ] Wangda Tan commented on YARN-10504: --- [~epayne], This is a feature to allow flexibly add and remove

[jira] [Created] (YARN-10508) Protobuf Mesage Incompatibility Detector

2020-11-30 Thread junwen yang (Jira)
junwen yang created YARN-10508: -- Summary: Protobuf Mesage Incompatibility Detector Key: YARN-10508 URL: https://issues.apache.org/jira/browse/YARN-10508 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241077#comment-17241077 ] Hadoop QA commented on YARN-10507: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241123#comment-17241123 ] Hadoop QA commented on YARN-10278: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10502) Add backlogs metric for CapacityScheduler

2020-11-30 Thread Wanqiang Ji (Jira)
[ https://issues.apache.org/jira/browse/YARN-10502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-10502: --- Target Version/s: 3.4.0 (was: 3.2.2, 3.4.0, 3.3.1) > Add backlogs metric for CapacityScheduler >

[jira] [Commented] (YARN-10380) Import logic of multi-node allocation in CapacityScheduler

2020-11-30 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241243#comment-17241243 ] Zhankun Tang commented on YARN-10380: - [~zhuqi], Thanks a lot for the contributions! It looks good to

[jira] [Comment Edited] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240742#comment-17240742 ] zhuqi edited comment on YARN-10169 at 12/1/20, 6:11 AM: [~leftnoteasy]

[jira] [Commented] (YARN-10380) Import logic of multi-node allocation in CapacityScheduler

2020-11-30 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241257#comment-17241257 ] zhuqi commented on YARN-10380: -- [~ztang] Thanks a lot for your patient review. I have fixed the check

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-11-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241269#comment-17241269 ] Hadoop QA commented on YARN-10169: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||