[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hung updated YARN-6152: -------------------------------- Description: YARN-4751 adds the {{getUsedCapacity}} and {{getAbsoluteUsedCapacity}} methods to {{AbstractCSQueue}} which is used to display queue usage in UI for branch-2.7 and below. However if there is more than one partition in the cluster, with different dominant resources, then queue usage may not be displayed as expected. Contrived example: Default partition has <90GB, 10vcores>, and "test" partition has <10GB, 90vcores>. {{root}} queue in default partition uses <30GB, 10vcores>. Here we expect queue usage to be 100 since it is using all vcores in default partition. But the displayed usage will be (30GB/100GB)/(90GB/100GB) = 33%. was: YARN-4751 adds the {{getUsedCapacity}} and {{getAbsoluteUsedCapacity}} methods to {{AbstractCSQueue}} which is used to display queue usage in UI for branch-2.7 and below. However if there is more than one partition in the cluster, with different dominant resources, then queue usage may not be displayed as expected. Contrived example: Default partition has <90GB, 10vcores>, and "test" partition has <10GB, 90vcores>. {{root}} queue in default partition uses <50GB, 10vcores>. Here we expect queue usage to be 100 since it is using all vcores in default partition. But the displayed usage will be (50GB/100GB)/(90GB/100GB) = 55.6%. > Used queue percentage not accurate in UI for 2.7 and below when using > DominantResourceCalculator > ------------------------------------------------------------------------------------------------ > > Key: YARN-6152 > URL: https://issues.apache.org/jira/browse/YARN-6152 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Jonathan Hung > Assignee: Jonathan Hung > Attachments: dominantRC.png > > > YARN-4751 adds the {{getUsedCapacity}} and {{getAbsoluteUsedCapacity}} > methods to {{AbstractCSQueue}} which is used to display queue usage in UI for > branch-2.7 and below. However if there is more than one partition in the > cluster, with different dominant resources, then queue usage may not be > displayed as expected. > Contrived example: Default partition has <90GB, 10vcores>, and "test" > partition has <10GB, 90vcores>. {{root}} queue in default partition uses > <30GB, 10vcores>. Here we expect queue usage to be 100 since it is using all > vcores in default partition. But the displayed usage will be > (30GB/100GB)/(90GB/100GB) = 33%. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org