[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305298#comment-17305298 ] Qi Zhu commented on YARN-10704: --- Fixed the checkstyle and test in latest patch. :D > The CS effective

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Attachment: YARN-10704.002.patch > The CS effective capacity for absolute mode in UI should support GPU and >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305290#comment-17305290 ] Qi Zhu commented on YARN-10503: --- Thanks [~epayne] for reply. I also think YARN-9936 is going beyond this

[jira] [Commented] (YARN-10493) RunC container repository v2

2021-03-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305211#comment-17305211 ] Hadoop QA commented on YARN-10493: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-6538) Inter Queue preemption is not happening when DRF is configured

2021-03-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305144#comment-17305144 ] Eric Payne commented on YARN-6538: -- [~novaboy], please provide a specific use case to reproduce this

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305110#comment-17305110 ] Jim Brennan commented on YARN-10702: Thanks for the suggestions [~gandras]! I agree this should be

[jira] [Commented] (YARN-10493) RunC container repository v2

2021-03-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305091#comment-17305091 ] Hadoop QA commented on YARN-10493: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6538) Inter Queue preemption is not happening when DRF is configured

2021-03-19 Thread Michael Zeoli (Jira)
[ https://issues.apache.org/jira/browse/YARN-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305084#comment-17305084 ] Michael Zeoli commented on YARN-6538: - As we transition from Fair Scheduler to Capacity Scheduler,

[jira] [Comment Edited] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-19 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305033#comment-17305033 ] Andras Gyori edited comment on YARN-10702 at 3/19/21, 5:10 PM: --- Thank you

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-19 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305033#comment-17305033 ] Andras Gyori commented on YARN-10702: - Thank you [~Jim_Brennan] for the contribution! The logic is

[jira] [Commented] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-03-19 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305024#comment-17305024 ] Ahmed Hussein commented on YARN-10597: -- That's interesting. I ran the unit tests in YARN-10425 from

[jira] [Updated] (YARN-10705) Misleading DEBUG log for container assignment needs to be removed when the container is actually reserved, not assigned in FairScheduler

2021-03-19 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10705: --- Affects Version/s: 3.4.0 > Misleading DEBUG log for container assignment needs to be removed

[jira] [Updated] (YARN-10705) Misleading DEBUG log for container assignment needs to be removed when the container is actually reserved, not assigned in FairScheduler

2021-03-19 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10705: --- Component/s: yarn > Misleading DEBUG log for container assignment needs to be removed when

[jira] [Assigned] (YARN-10705) Misleading DEBUG log for container assignment needs to be removed when the container is actually reserved, not assigned in FairScheduler

2021-03-19 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja reassigned YARN-10705: -- Assignee: Siddharth Ahuja > Misleading DEBUG log for container assignment needs to be

[jira] [Created] (YARN-10705) Misleading DEBUG log for container assignment needs to be removed when the container is actually reserved, not assigned in FairScheduler

2021-03-19 Thread Siddharth Ahuja (Jira)
Siddharth Ahuja created YARN-10705: -- Summary: Misleading DEBUG log for container assignment needs to be removed when the container is actually reserved, not assigned in FairScheduler Key: YARN-10705 URL:

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

2021-03-19 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304992#comment-17304992 ] Andras Gyori edited comment on YARN-9927 at 3/19/21, 4:10 PM: -- Thank you

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

2021-03-19 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304992#comment-17304992 ] Andras Gyori commented on YARN-9927: Thank you [~hcarrot] for raising this issue and [~zhuqi] for

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

2021-03-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304984#comment-17304984 ] Eric Payne commented on YARN-10503: --- [~leftnoteasy] and [~sunilg], is there a reason custom resources

[jira] [Commented] (YARN-10493) RunC container repository v2

2021-03-19 Thread Matthew Sharp (Jira)
[ https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304979#comment-17304979 ] Matthew Sharp commented on YARN-10493: -- I have an initial PR to address the improvements outlined in

[jira] [Updated] (YARN-10493) RunC container repository v2

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10493: -- Labels: pull-request-available (was: ) > RunC container repository v2 >

[jira] [Comment Edited] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304971#comment-17304971 ] Peter Bacsko edited comment on YARN-10597 at 3/19/21, 3:35 PM: --- [~shuzirra]

[jira] [Commented] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304971#comment-17304971 ] Peter Bacsko commented on YARN-10597: - [~shuzirra] is it really that simple? You told me that there

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304941#comment-17304941 ] Jim Brennan commented on YARN-10697: {quote} So can we introduce a new method in Resource.java which

[jira] [Assigned] (YARN-10534) Enable runC container transformations

2021-03-19 Thread Matthew Sharp (Jira)
[ https://issues.apache.org/jira/browse/YARN-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Sharp reassigned YARN-10534: Assignee: Matthew Sharp > Enable runC container transformations >

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304816#comment-17304816 ] Hadoop QA commented on YARN-10704: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Summary: The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[jira] [Comment Edited] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304701#comment-17304701 ] Qi Zhu edited comment on YARN-10704 at 3/19/21, 8:00 AM: - cc [~pbacsko] 

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU.

2021-03-19 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304701#comment-17304701 ] Qi Zhu commented on YARN-10704: --- cc [~pbacsko]  [~gandras] [~ebadger]   Could you help review this, i