[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.005.patch > fs2cs: should support auto created queue deletion. >

[jira] [Created] (YARN-10686) Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

Qi Zhu created YARN-10686: - Summary: Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error. Key: YARN-10686 URL: https://issues.apache.org/jira/browse/YARN-10686 Project: Hadoop YARN

[jira] [Updated] (YARN-10686) Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

[ https://issues.apache.org/jira/browse/YARN-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10686: -- Attachment: YARN-10686.001.patch > Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.006.patch > fs2cs: should support auto created queue deletion. >

[jira] [Commented] (YARN-10686) Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

[ https://issues.apache.org/jira/browse/YARN-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299266#comment-17299266 ] Qi Zhu commented on YARN-10686: ---  [~pbacsko]  [~shuzirra] The testAutoQueueCreationFailsForEmptyPath is

[jira] [Updated] (YARN-10686) Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

[ https://issues.apache.org/jira/browse/YARN-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10686: -- Attachment: (was: YARN-10686.001.patch) > Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode

[jira] [Updated] (YARN-10685) Fixed some Typo in AbstractCSQueue.

[ https://issues.apache.org/jira/browse/YARN-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10685: -- Attachment: YARN-10685.003.patch > Fixed some Typo in AbstractCSQueue. >

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Description: Now the two option: max-disk-utilization-per-disk-percentage min-free-space-per-disk-mb for

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299361#comment-17299361 ] Qi Zhu commented on YARN-10674: --- Thanks [~gandras] for patient review. 1. Actually the observe is confused

[jira] [Commented] (YARN-10682) The scheduler monitor policies conf should support trim between ",".

[ https://issues.apache.org/jira/browse/YARN-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299366#comment-17299366 ] Qi Zhu commented on YARN-10682: --- Thanks a lot [~gandras] for review. [~pbacsko] if you any other advice?:D

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Component/s: resourcemanager > ClusterMetrics should support GPU related metrics. >

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Description: Now the ClusterMetrics only support memory and Vcore related metrics.   {code:java}

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Description: Now the ClusterMetrics only support memory and Vcore related metrics. In our cluster, we added

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Affects Version/s: 3.4.0 3.2.2 > ClusterMetrics should support GPU related metrics. >

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Description: Now the ClusterMetrics only support memory and Vcore related metrics. In our cluster, we added

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Component/s: metrics > ClusterMetrics should support GPU related metrics. >

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Issue Type: Improvement (was: Bug) > ClusterMetrics should support GPU related metrics. >

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299387#comment-17299387 ] Qi Zhu commented on YARN-10687: --- Thanks a lot [~gandras] for review, very valid suggestion to me. I will

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Description: Now the two option: max-disk-utilization-per-disk-percentage min-free-space-per-disk-mb for

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Affects Version/s: 3.2.2 > Add option to disable/enable free disk space checking and percentage checking >

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Component/s: nodemanager > Add option to disable/enable free disk space checking and percentage checking >

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Description: Now the two option: max-disk-utilization-per-disk-percentage min-free-space-per-disk-mb for

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Affects Version/s: 3.4.0 > Add option to disable/enable free disk space checking and percentage checking >

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299336#comment-17299336 ] Qi Zhu commented on YARN-10687: ---  [~pbacsko]  [~Jim_Brennan]  [~ebadger]  [~gandras]  If you could help

[jira] [Created] (YARN-10688) ClusterMetrics should support GPU related metrics.

Qi Zhu created YARN-10688: - Summary: ClusterMetrics should support GPU related metrics. Key: YARN-10688 URL: https://issues.apache.org/jira/browse/YARN-10688 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Attachment: image-2021-03-11-15-35-49-625.png > ClusterMetrics should support GPU related metrics. >

[jira] [Created] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

Qi Zhu created YARN-10687: - Summary: Add option to disable/enable free disk space checking and percentage checking for full and not-full disks Key: YARN-10687 URL: https://issues.apache.org/jira/browse/YARN-10687

[jira] [Commented] (YARN-10686) Fix testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode user error.

[ https://issues.apache.org/jira/browse/YARN-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299367#comment-17299367 ] Qi Zhu commented on YARN-10686: --- Thanks a lot [~gandras] for review.  [~pbacsko] If you any other

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Description: Now the ClusterMetrics only support memory and Vcore related metrics.   {code:java}

[jira] [Created] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

Qi Zhu created YARN-10707: - Summary: Support gpu in ResourceUtilization, and update Node GPU Utilization to use. Key: YARN-10707 URL: https://issues.apache.org/jira/browse/YARN-10707 Project: Hadoop YARN

[jira] [Updated] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Description: Support gpu in ResourceUtilization, and update Node GPU Utilization to use first. It will be

[jira] [Updated] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Description: Support gpu in ResourceUtilization, and update Node GPU Utilization to use. It will be very

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305680#comment-17305680 ] Qi Zhu commented on YARN-10707: --- [~ebadger] [~pbacsko] [~gandras]  I add the gpu Support in

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:09 AM: Thanks [~gandras] for

[jira] [Updated] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.002.patch > Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[jira] [Comment Edited] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304228#comment-17304228 ] Qi Zhu edited comment on YARN-10674 at 3/22/21, 3:45 AM: - [~gandras] Now i

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:06 AM: Thanks [~gandras] for

[jira] [Updated] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.003.patch > Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu commented on YARN-9927: -- Thanks [~gandras] for investigation and reply. I agree with you that which

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:11 AM: Thanks [~gandras] for

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu edited comment on YARN-9618 at 3/22/21, 8:21 AM: Thanks [~gandras] for deep

[jira] [Commented] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu commented on YARN-9618: -- [~gandras] You are right, main performance gain here is due to eliminating

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.003.patch > Support queue capacity in terms of absolute resources with gpu

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306098#comment-17306098 ] Qi Zhu commented on YARN-10707: --- Fixed the checkstyle in latest patch.   > Support gpu in

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306074#comment-17306074 ] Qi Zhu commented on YARN-10503: ---  As [~epayne] suggested. [~epayne] [~ebadger] [~gandras] [~pbacsko]

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306074#comment-17306074 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 10:47 AM: --  As [~epayne]

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu edited comment on YARN-9618 at 3/22/21, 8:25 AM: Thanks [~gandras] for deep

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu commented on YARN-10503: --- Thanks [~pbacsko] for review. I add this to support more string types to

[jira] [Commented] (YARN-10645) Fix queue state related update for auto created queue.

[ https://issues.apache.org/jira/browse/YARN-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306207#comment-17306207 ] Qi Zhu commented on YARN-10645: --- Thanks [~pbacsko] for reply. It is included in YARN-10564 now, and i

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Attachment: YARN-10704.003.patch > The CS effective capacity for absolute mode in UI should support GPU and >

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306163#comment-17306163 ] Qi Zhu commented on YARN-10704: --- Thanks [~pbacsko] for review. I have fixed above in latest patch. > The

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 12:47 PM: -- Thanks [~pbacsko] for

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 12:47 PM: -- Thanks [~pbacsko] for

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305469#comment-17305469 ] Qi Zhu edited comment on YARN-10517 at 3/22/21, 2:50 PM: - I meet the problem too.

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306215#comment-17306215 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] If any advice about this? Thanks.:D > fs2cs: should support

[jira] [Commented] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306213#comment-17306213 ] Qi Zhu commented on YARN-9936: -- Thanks [~gandras] for taking. It's an important feature to CS.    >

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Attachment: YARN-10704.002.patch > The CS effective capacity for absolute mode in UI should support GPU and >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305290#comment-17305290 ] Qi Zhu commented on YARN-10503: --- Thanks [~epayne] for reply. I also think YARN-9936 is going beyond this

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305298#comment-17305298 ] Qi Zhu commented on YARN-10704: --- Fixed the checkstyle and test in latest patch. :D > The CS effective

[jira] [Assigned] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10517: - Assignee: Qi Zhu > QueueMetrics has incorrect Allocated Resource when labelled partitions updated >

[jira] [Updated] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10517: -- Fix Version/s: (was: 3.2.3) (was: 3.3.1) > QueueMetrics has incorrect Allocated

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297785#comment-17297785 ] Qi Zhu edited comment on YARN-10178 at 3/20/21, 2:16 PM: - Thanks [~pbacsko] for

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305469#comment-17305469 ] Qi Zhu commented on YARN-10517: --- I meet the problem too. I fixed it and add corresponding test in  

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Summary: The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300019#comment-17300019 ] Qi Zhu commented on YARN-10687: --- Thanks a lot [~Jim_Brennan] for patient review. I have fixed it in latest

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Attachment: YARN-10687.003.patch > Add option to disable/enable free disk space checking and percentage

[jira] [Commented] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300068#comment-17300068 ] Qi Zhu commented on YARN-10688: --- [~ebadger] [~Jim_Brennan] The remaining test is not related to this, and

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with more resourceTypes.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Description: Now the absolute resources are memory and cores. {code:java} /** * Different resource types

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with more resourceTypes.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Description: Now the absolute resources are memory and cores. {code:java} /** * Different resource types

[jira] [Commented] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1725#comment-1725 ] Qi Zhu commented on YARN-10688: --- Thanks a lot [~ebadger] for review. Fixed it in latest patch, and also

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Attachment: YARN-10688.002.patch > ClusterMetrics should support GPU related metrics. >

[jira] [Comment Edited] (YARN-10688) ClusterMetrics should support GPU related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1725#comment-1725 ] Qi Zhu edited comment on YARN-10688 at 3/12/21, 2:40 AM: - Thanks a lot [~ebadger]

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.007.patch > fs2cs: should support auto created queue deletion. >

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with more resourceTypes.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Description: Now the absolute resources are memory and cores. {code:java} /** * Different resource types

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300069#comment-17300069 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] [~gandras] Updated this in latest patch for review.:D Thanks.

[jira] [Updated] (YARN-10688) ClusterMetrics should support GPU capacity related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10688: -- Summary: ClusterMetrics should support GPU capacity related metrics. (was: ClusterMetrics should support GPU

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Summary: Support queue capacity in terms of absolute resources with gpu resourceType. (was: Support queue

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300121#comment-17300121 ] Qi Zhu commented on YARN-10503: --- Updated a patch for review. cc [~pbacsko] [~gandras] [~ebadger] 

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Priority: Critical (was: Major) > Support queue capacity in terms of absolute resources with gpu

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300155#comment-17300155 ] Qi Zhu commented on YARN-10687: --- Fixed the remaining checkstyle in latest patch. > Add option to

[jira] [Updated] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10687: -- Attachment: YARN-10687.004.patch > Add option to disable/enable free disk space checking and percentage

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300121#comment-17300121 ] Qi Zhu edited comment on YARN-10503 at 3/12/21, 8:09 AM: - Updated a patch for

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299461#comment-17299461 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] [~gandras] Ah, Now it makes sense to me. The preemption also

[jira] [Comment Edited] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299461#comment-17299461 ] Qi Zhu edited comment on YARN-10674 at 3/11/21, 10:07 AM: -- [~pbacsko] [~gandras]

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.014.patch > fs2cs: should support auto created queue deletion. >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu commented on YARN-10702: --- Thanks [~Jim_Brennan] for this. It makes sense to me, and it's a very

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10702: -- Parent: YARN-10695 Issue Type: Sub-task (was: Improvement) > Add cluster metric for amount of CPU

[jira] [Updated] (YARN-10695) Event related improvement of YARN for better usage.

[ https://issues.apache.org/jira/browse/YARN-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10695: -- Description: This jira, marked the event related improvement in yarn for better usage.  cc [~Jim_Brennan] 

[jira] [Updated] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10692: -- Attachment: YARN-10692.003.patch > Add Node GPU Utilization and apply to NodeMetrics. >

[jira] [Commented] (YARN-10688) ClusterMetrics should support GPU capacity related metrics.

[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303816#comment-17303816 ] Qi Zhu commented on YARN-10688: --- Thanks [~ebadger] for commit and  cherry-pick. > ClusterMetrics should

[jira] [Commented] (YARN-10692) Add Node GPU Utilization and apply to NodeMetrics.

[ https://issues.apache.org/jira/browse/YARN-10692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303814#comment-17303814 ] Qi Zhu commented on YARN-10692: --- Thanks [~pbacsko] for good suggestion. Updated in latest patch.

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303124#comment-17303124 ] Qi Zhu edited comment on YARN-9618 at 3/18/21, 2:46 AM: [~Jim_Brennan] [~gandras]

[jira] [Comment Edited] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu edited comment on YARN-10702 at 3/18/21, 3:15 AM: - Thanks [~Jim_Brennan] 

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303804#comment-17303804 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] [~gandras]  Fixed the checkstyle and change to assertTrue in 

[jira] [Comment Edited] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303804#comment-17303804 ] Qi Zhu edited comment on YARN-10674 at 3/18/21, 2:20 AM: - [~pbacsko] [~gandras] 

[jira] [Comment Edited] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303809#comment-17303809 ] Qi Zhu edited comment on YARN-10702 at 3/18/21, 2:27 AM: - Thanks [~Jim_Brennan] 

[jira] [Updated] (YARN-10690) ClusterMetrics should support GPU utilization related metrics.

[ https://issues.apache.org/jira/browse/YARN-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10690: -- Issue Type: Improvement (was: Bug) > ClusterMetrics should support GPU utilization related metrics. >

[jira] [Created] (YARN-10690) ClusterMetrics should support GPU utilization related metrics.

Qi Zhu created YARN-10690: - Summary: ClusterMetrics should support GPU utilization related metrics. Key: YARN-10690 URL: https://issues.apache.org/jira/browse/YARN-10690 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8823) Monitor the healthy state of GPU

[ https://issues.apache.org/jira/browse/YARN-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299419#comment-17299419 ] Qi Zhu commented on YARN-8823: -- Thanks [~adam.antal] for reply. I will investigate it when i am free. >

[jira] [Created] (YARN-10689) Fix the finding bugs in extractFloatValueFromWeightConfig.

Qi Zhu created YARN-10689: - Summary: Fix the finding bugs in extractFloatValueFromWeightConfig. Key: YARN-10689 URL: https://issues.apache.org/jira/browse/YARN-10689 Project: Hadoop YARN Issue Type:

<    1   2   3   4   5   6   7   8   9   10   >