[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9936: - Description: Currently, the Capacity Scheduler queue configuration supports two ways to set queue capacity. *

[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9936: - Description: Currently, the Capacity Scheduler queue configuration supports two ways to set queue capacity. *

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Summary: Support queue capacity in terms of absolute resources with custom resourceType. (was: Support queue

[jira] [Updated] (YARN-10708) Remove NULL check before instanceof

[ https://issues.apache.org/jira/browse/YARN-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajun Jiang updated YARN-10708: Attachment: YARN-10708.patch > Remove NULL check before instanceof >

[jira] [Resolved] (YARN-10710) [Clean-up] Remove NULL check before instanceof

[ https://issues.apache.org/jira/browse/YARN-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajun Jiang resolved YARN-10710. - Resolution: Duplicate > [Clean-up] Remove NULL check before instanceof >

[jira] [Resolved] (YARN-10709) Remove NULL check before instanceof

[ https://issues.apache.org/jira/browse/YARN-10709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiajun Jiang resolved YARN-10709. - Resolution: Duplicate > Remove NULL check before instanceof >

[jira] [Created] (YARN-10710) [Clean-up] Remove NULL check before instanceof

Jiajun Jiang created YARN-10710: --- Summary: [Clean-up] Remove NULL check before instanceof Key: YARN-10710 URL: https://issues.apache.org/jira/browse/YARN-10710 Project: Hadoop YARN Issue

[jira] [Created] (YARN-10709) Remove NULL check before instanceof

Jiajun Jiang created YARN-10709: --- Summary: Remove NULL check before instanceof Key: YARN-10709 URL: https://issues.apache.org/jira/browse/YARN-10709 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-10708) Remove NULL check before instanceof

Jiajun Jiang created YARN-10708: --- Summary: Remove NULL check before instanceof Key: YARN-10708 URL: https://issues.apache.org/jira/browse/YARN-10708 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306489#comment-17306489 ] Jim Brennan edited comment on YARN-10697 at 3/22/21, 7:02 PM: -- Thanks for

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306489#comment-17306489 ] Jim Brennan commented on YARN-10697: Thanks for the update [~BilwaST]! +1 patch 002 looks good to

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306292#comment-17306292 ] Hadoop QA commented on YARN-10704: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305469#comment-17305469 ] Qi Zhu edited comment on YARN-10517 at 3/22/21, 2:50 PM: - I meet the problem too.

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306240#comment-17306240 ] Peter Bacsko commented on YARN-10674: - [~zhuqi] I had a discussion with [~gandras], he will post an

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306215#comment-17306215 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] If any advice about this? Thanks.:D > fs2cs: should support

[jira] [Commented] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306213#comment-17306213 ] Qi Zhu commented on YARN-9936: -- Thanks [~gandras] for taking. It's an important feature to CS.    >

[jira] [Assigned] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori reassigned YARN-9936: -- Assignee: Andras Gyori (was: Zoltan Siegl) > Support vector of capacity percentages in

[jira] [Commented] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306212#comment-17306212 ] Andras Gyori commented on YARN-9936: I can see that it is not actively developed, so I take it over.

[jira] [Commented] (YARN-10645) Fix queue state related update for auto created queue.

[ https://issues.apache.org/jira/browse/YARN-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306207#comment-17306207 ] Qi Zhu commented on YARN-10645: --- Thanks [~pbacsko] for reply. It is included in YARN-10564 now, and i

[jira] [Commented] (YARN-10645) Fix queue state related update for auto created queue.

[ https://issues.apache.org/jira/browse/YARN-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306203#comment-17306203 ] Peter Bacsko commented on YARN-10645: - [~zhuqi] [~gandras] is this patch still needed? Looking at

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306183#comment-17306183 ] Hadoop QA commented on YARN-10503: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306175#comment-17306175 ] Gergely Pollak commented on YARN-10597: --- [~ahussein] thank you for the feedback, I'll take a look

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 12:47 PM: -- Thanks [~pbacsko] for

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 12:47 PM: -- Thanks [~pbacsko] for

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306170#comment-17306170 ] Qi Zhu commented on YARN-10503: --- Thanks [~pbacsko] for review. I add this to support more string types to

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306163#comment-17306163 ] Qi Zhu commented on YARN-10704: --- Thanks [~pbacsko] for review. I have fixed above in latest patch. > The

[jira] [Updated] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10704: -- Attachment: YARN-10704.003.patch > The CS effective capacity for absolute mode in UI should support GPU and >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306157#comment-17306157 ] Peter Bacsko commented on YARN-10503: - The question is this part: {noformat} public enum

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306154#comment-17306154 ] Peter Bacsko commented on YARN-10704: - Thanks [~zhuqi] I have some minor comments: 1. {noformat}

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306074#comment-17306074 ] Qi Zhu edited comment on YARN-10503 at 3/22/21, 10:47 AM: --  As [~epayne]

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306098#comment-17306098 ] Qi Zhu commented on YARN-10707: --- Fixed the checkstyle in latest patch.   > Support gpu in

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306074#comment-17306074 ] Qi Zhu commented on YARN-10503: ---  As [~epayne] suggested. [~epayne] [~ebadger] [~gandras] [~pbacsko]

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with gpu resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.003.patch > Support queue capacity in terms of absolute resources with gpu

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306068#comment-17306068 ] Hadoop QA commented on YARN-10707: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10370) [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules

[ https://issues.apache.org/jira/browse/YARN-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306053#comment-17306053 ] Szilard Nemeth edited comment on YARN-10370 at 3/22/21, 9:37 AM: - Hi

[jira] [Commented] (YARN-10370) [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules

[ https://issues.apache.org/jira/browse/YARN-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306053#comment-17306053 ] Szilard Nemeth commented on YARN-10370: --- Hi [~pbacsko], Good idea. Let's wait for [~shuzirra]'s

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306036#comment-17306036 ] Hadoop QA commented on YARN-10707: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu edited comment on YARN-9618 at 3/22/21, 8:25 AM: Thanks [~gandras] for deep

[jira] [Comment Edited] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu edited comment on YARN-9618 at 3/22/21, 8:21 AM: Thanks [~gandras] for deep

[jira] [Commented] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305978#comment-17305978 ] Qi Zhu commented on YARN-9618: -- [~gandras] You are right, main performance gain here is due to eliminating

[jira] [Commented] (YARN-9618) NodeListManager event improvement

[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305953#comment-17305953 ] Andras Gyori commented on YARN-9618: Thank you [~zhuqi] for the patch. I have analysed the code a bit

[jira] [Updated] (YARN-10684) YARN: Opportunistic Container :: Distributed YARN Job has Failed when tried adding flag -promote_opportunistic_after_start

[ https://issues.apache.org/jira/browse/YARN-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanta Sen updated YARN-10684: Description: Preconditions: # Secure Hadoop 3.1.1 - 3 Nodes cluster is installed # Set the below

[jira] [Updated] (YARN-10670) YARN: Opportunistic Container : : In distributed shell job if containers are killed then application is failed. But in this case as containers are killed to make room for

[ https://issues.apache.org/jira/browse/YARN-10670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanta Sen updated YARN-10670: Description: Preconditions: # Secure Hadoop 3.1.1 - 3 Nodes cluster is installed # Set the below

[jira] [Updated] (YARN-10670) YARN: Opportunistic Container : : In distributed shell job if containers are killed then application is failed. But in this case as containers are killed to make room for

[ https://issues.apache.org/jira/browse/YARN-10670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanta Sen updated YARN-10670: Description: Preconditions: # Secure Hadoop 3.1.1 - 3 Nodes cluster is installed # Set the below

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305941#comment-17305941 ] Andras Gyori commented on YARN-9927: Thanks [~zhuqi] for the answer, I agree with your concerns.

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:11 AM: Thanks [~gandras] for

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:09 AM: Thanks [~gandras] for

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305895#comment-17305895 ] Qi Zhu edited comment on YARN-9927 at 3/22/21, 6:06 AM: Thanks [~gandras] for

[jira] [Resolved] (YARN-10706) Upgrade com.github.eirslett:frontend-maven-plugin to 1.11.2

[ https://issues.apache.org/jira/browse/YARN-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved YARN-10706. -- Fix Version/s: 3.2.3 3.3.1 3.4.0 Hadoop Flags: