[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10642: -- Parent: YARN-10695 Issue Type: Sub-task (was: Bug) > Race condition: AsyncDispatcher can get stuck by

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303177#comment-17303177 ] Andras Gyori commented on YARN-10692: - Thank you [~zhuqi] for the patch. I have the following

[jira] [Updated] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10697: - Attachment: YARN-10697.001.patch > Resources are displayed in bytes in UI for schedulers other than

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303190#comment-17303190 ] Andras Gyori commented on YARN-10497: - Thank you [~zhuqi], seems to be a straightforward change,

[jira] [Created] (YARN-10700) Yarn can't submit application, resourcemanager get stuck but not dead

2021-03-17 Thread leix (Jira)
leix created YARN-10700: --- Summary: Yarn can't submit application, resourcemanager get stuck but not dead Key: YARN-10700 URL: https://issues.apache.org/jira/browse/YARN-10700 Project: Hadoop YARN

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

2021-03-17 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303185#comment-17303185 ] Andras Gyori commented on YARN-10503: - I agree with [~ebadger]. Not only do we need to extend this

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303184#comment-17303184 ] Hadoop QA commented on YARN-9618: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10697: - Attachment: image-2021-03-17-11-30-57-216.png > Resources are displayed in bytes in UI for schedulers

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303120#comment-17303120 ] Bilwa S T commented on YARN-10697: -- In YARN-10251 in if case they removed multiplying by BYTES_IN_MB

[jira] [Updated] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9618: - Attachment: YARN-9618.005.patch > NodeListManager event improvement > - > >

[jira] [Commented] (YARN-10685) Fixed some Typo in AbstractCSQueue.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303130#comment-17303130 ] Qi Zhu commented on YARN-10685: --- [~gandras] [~pbacsko] Could you help review this? Thanks. > Fixed some

[jira] [Comment Edited] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298059#comment-17298059 ] Qi Zhu edited comment on YARN-10497 at 3/17/21, 6:12 AM: - [~gandras] [~shuzirra] 

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303123#comment-17303123 ] Bilwa S T commented on YARN-10697: -- [~epayne]  [~jbrennan] can you please take a look at this? >

[jira] [Commented] (YARN-10700) Yarn can't submit application, resourcemanager get stuck but not dead

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303143#comment-17303143 ] Qi Zhu commented on YARN-10700: --- Thanks [~leix2020] for report. Actually it is the jdk bug, and we have

[jira] [Commented] (YARN-10495) make the rpath of container-executor configurable

2021-03-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303126#comment-17303126 ] angerszhu commented on YARN-10495: -- [~ebadger] All right, we meet a problem that we use dockfile ti

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303124#comment-17303124 ] Qi Zhu commented on YARN-9618: -- [~gandras] [~ebadger] Added the EventDispatcher in created logic, to make

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.013.patch > fs2cs: should support auto created queue deletion. >

[jira] [Updated] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10701: -- Attachment: YARN-10701.002.patch > The yarn.resource-types should support multi types without trimmed. >

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303448#comment-17303448 ] Qi Zhu commented on YARN-10674: --- Thanks a lot [~gandras] for patient review. [~pbacsko] I have updated

[jira] [Assigned] (YARN-10493) RunC container repository v2

2021-03-17 Thread Matthew Sharp (Jira)
[ https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Sharp reassigned YARN-10493: Assignee: Matthew Sharp (was: mbsharp85) > RunC container repository v2 >

[jira] [Updated] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10692: -- Attachment: YARN-10692.002.patch > Add Node GPU Utilization and apply to NodeMetrics. >

[jira] [Assigned] (YARN-10494) CLI tool for docker-to-squashfs conversion (pure Java)

2021-03-17 Thread Matthew Sharp (Jira)
[ https://issues.apache.org/jira/browse/YARN-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Sharp reassigned YARN-10494: Assignee: Matthew Sharp (was: mbsharp85) > CLI tool for docker-to-squashfs conversion

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303407#comment-17303407 ] Hadoop QA commented on YARN-10701: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303476#comment-17303476 ] Qi Zhu commented on YARN-10701: --- [~pbacsko] Fixed checkstyle in latest patch.   > The

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303511#comment-17303511 ] Qi Zhu commented on YARN-10692: --- [~ebadger] [~gandras] [~pbacsko] Updated this in latest patch. Thanks.

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303124#comment-17303124 ] Qi Zhu edited comment on YARN-9618 at 3/17/21, 9:20 AM: [~gandras] [~ebadger] 

[jira] [Updated] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10701: -- Description: {code:java} yarn.resource-types yarn.io/gpu, yarn.io/fpga {code} When i configured the

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303245#comment-17303245 ] Peter Bacsko commented on YARN-10497: - I think it's good. Let's wait for Jenkins and I'll commit it.

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303206#comment-17303206 ] Qi Zhu commented on YARN-10503: --- Thanks [~gandras] [~ebadger] for review: Actually, i just want to support

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303208#comment-17303208 ] Qi Zhu commented on YARN-10497: --- Thanks [~gandras] for review. I removed the mocking logic in

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303222#comment-17303222 ] Peter Bacsko commented on YARN-10674: - [~gandras] do you have further comments? I think the patch is

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303233#comment-17303233 ] Qi Zhu commented on YARN-10701: --- cc [~pbacsko] [~ebadger] [~epayne] [~gandras]  [~bteke] When i tested my

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303278#comment-17303278 ] Qi Zhu commented on YARN-9618: -- The test is not related. > NodeListManager event improvement >

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303278#comment-17303278 ] Qi Zhu edited comment on YARN-9618 at 3/17/21, 10:25 AM: - The test error is not

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303365#comment-17303365 ] Peter Bacsko commented on YARN-10497: - +1 Thanks [~wangda] / [~zhuqi] for the patch and [~gandras],

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10497: Labels: capacity-scheduler capacityscheduler (was: ) > Fix an issue in CapacityScheduler which

[jira] [Updated] (YARN-10638) Add fair call queue support to event processing queue.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10638: -- Parent: YARN-10695 Issue Type: Sub-task (was: New Feature) > Add fair call queue support to event

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303256#comment-17303256 ] Hadoop QA commented on YARN-9618: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303204#comment-17303204 ] Qi Zhu commented on YARN-10692: --- Thanks [~ebadger] [~gandras] for review * If gpuList size is zero, you

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303335#comment-17303335 ] Andras Gyori commented on YARN-10674: - Overall logic seems good to me, this is the safest choice of

[jira] [Created] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10701: - Summary: The yarn.resource-types should support multi types without trimmed. Key: YARN-10701 URL: https://issues.apache.org/jira/browse/YARN-10701 Project: Hadoop YARN

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303247#comment-17303247 ] Qi Zhu commented on YARN-10497: --- Thanks  [~pbacsko]  for confirm.  > Fix an issue in CapacityScheduler

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303260#comment-17303260 ] Hadoop QA commented on YARN-10697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10497: -- Attachment: YARN-10497.006.patch > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303324#comment-17303324 ] Hadoop QA commented on YARN-10497: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303342#comment-17303342 ] Peter Bacsko commented on YARN-10674: - [~gandras] good suggestions, thanks! [~zhuqi] please apply the

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303562#comment-17303562 ] Hadoop QA commented on YARN-10692: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303542#comment-17303542 ] Peter Bacsko edited comment on YARN-10692 at 3/17/21, 4:11 PM: --- Thanks

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303625#comment-17303625 ] Hadoop QA commented on YARN-10701: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303542#comment-17303542 ] Peter Bacsko commented on YARN-10692: - Thanks [~zhuqi] in general this looks good. I just have two

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303594#comment-17303594 ] Hadoop QA commented on YARN-10674: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303747#comment-17303747 ] Jim Brennan commented on YARN-10697: [~BilwaST] I agree about the bug in

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU capacity related metrics.

2021-03-17 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10688: --- Fix Version/s: 3.2.3 3.3.1 3.4.0 Thanks for the updated patch,

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303691#comment-17303691 ] Hadoop QA commented on YARN-10702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.002.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303724#comment-17303724 ] Jim Brennan commented on YARN-10702: patch 002 is rebased to current trunk. > Add cluster metric for

[jira] [Created] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10702: -- Summary: Add cluster metric for amount of CPU used by RM Event Processor Key: YARN-10702 URL: https://issues.apache.org/jira/browse/YARN-10702 Project: Hadoop YARN

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.001.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: simon-scheduler-busy.png > Add cluster metric for amount of CPU used by RM Event

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303697#comment-17303697 ] Jim Brennan commented on YARN-10702: Attaching some images of how this looks on the RM legacy UI and

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: Scheduler-Busy.png > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10370) [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules

2021-03-17 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303767#comment-17303767 ] Gergely Pollak commented on YARN-10370: --- [~pbacsko] thank you for the advice, I agree we can close

[jira] [Updated] (YARN-10659) Improve CS MappingRule %secondary_group evaluation

2021-03-17 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10659: -- Attachment: YARN-10659.003.patch > Improve CS MappingRule %secondary_group evaluation >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303777#comment-17303777 ] Hadoop QA commented on YARN-10702: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10659) Improve CS MappingRule %secondary_group evaluation

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303837#comment-17303837 ] Hadoop QA commented on YARN-10659: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303841#comment-17303841 ] Hadoop QA commented on YARN-10597: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303847#comment-17303847 ] Hadoop QA commented on YARN-10692: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303854#comment-17303854 ] Hadoop QA commented on YARN-10674: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.014.patch > fs2cs: should support auto created queue deletion. >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu commented on YARN-10702: --- Thanks [~Jim_Brennan] for this. It makes sense to me, and it's a very

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10702: -- Parent: YARN-10695 Issue Type: Sub-task (was: Improvement) > Add cluster metric for amount of CPU

[jira] [Updated] (YARN-10695) Event related improvement of YARN for better usage.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10695: -- Description: This jira, marked the event related improvement in yarn for better usage.  cc [~Jim_Brennan] 

[jira] [Updated] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10692: -- Attachment: YARN-10692.003.patch > Add Node GPU Utilization and apply to NodeMetrics. >

[jira] [Commented] (YARN-10688) ClusterMetrics should support GPU capacity related metrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303816#comment-17303816 ] Qi Zhu commented on YARN-10688: --- Thanks [~ebadger] for commit and  cherry-pick. > ClusterMetrics should

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303814#comment-17303814 ] Qi Zhu commented on YARN-10692: --- Thanks [~pbacsko] for good suggestion. Updated in latest patch.

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303124#comment-17303124 ] Qi Zhu edited comment on YARN-9618 at 3/18/21, 2:46 AM: [~Jim_Brennan] [~gandras]

[jira] [Comment Edited] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu edited comment on YARN-10702 at 3/18/21, 3:15 AM: - Thanks [~Jim_Brennan] 

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303804#comment-17303804 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] [~gandras]  Fixed the checkstyle and change to assertTrue in 

[jira] [Comment Edited] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303804#comment-17303804 ] Qi Zhu edited comment on YARN-10674 at 3/18/21, 2:20 AM: - [~pbacsko] [~gandras] 

[jira] [Comment Edited] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu edited comment on YARN-10702 at 3/18/21, 2:27 AM: - Thanks [~Jim_Brennan]