[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wangda Tan updated YARN-8292: ----------------------------- Description: This is an example of the problem: (Same if we have more than 2 resources) Let's say we have 3 queues A/B/C. All containers with equal size <2,3> ||Queue||Guaranteed||Used ||Pending|| |A|<20, 10>|<20,30>| | |B|<20, 10>|0|0| |C|<20, 10>|0|<20, 30>| | | | | | Under current logic, A's calculated to-preempt (how much resource other queue can preempt) will be <0, 20>. The preemption will not happen. However, under the context of DRC, queue A is using more resource than guaranteed, so queue C will be starved was: This is an example of the problem: (Same if we have more than 2 resources) Let's say we have 3 queues A/B/C. All containers with equal size <2,3> ||Queue||Guaranteed||Used ||Pending|| |A|<20, 10>|<20,30>| | |B|<20, 10>|0|0| |C|<20, 10>|0|<20, 30>| | | | | | Under current logic, A's calculated to-preempt (how much resource other queue can preempt) will be <0, 20>. The preemption will not happen. > Fix the dominant resource preemption cannot happen when some of the resource > vector becomes negative > ---------------------------------------------------------------------------------------------------- > > Key: YARN-8292 > URL: https://issues.apache.org/jira/browse/YARN-8292 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn > Reporter: Sumana Sathish > Assignee: Wangda Tan > Priority: Critical > > > This is an example of the problem: (Same if we have more than 2 resources) > > Let's say we have 3 queues A/B/C. All containers with equal size <2,3> > > ||Queue||Guaranteed||Used ||Pending|| > |A|<20, 10>|<20,30>| | > |B|<20, 10>|0|0| > |C|<20, 10>|0|<20, 30>| > | | | | | > > Under current logic, A's calculated to-preempt (how much resource other queue > can preempt) will be <0, 20>. The preemption will not happen. However, under > the context of DRC, queue A is using more resource than guaranteed, so queue > C will be starved -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org