[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Botong Huang updated YARN-7317: ------------------------------- Attachment: YARN-7317.v2.patch Thanks [~curino] for the review, v2 patch uploaded. > Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy > ---------------------------------------------------------------------------- > > Key: YARN-7317 > URL: https://issues.apache.org/jira/browse/YARN-7317 > Project: Hadoop YARN > Issue Type: Task > Reporter: Botong Huang > Assignee: Botong Huang > Priority: Minor > Attachments: YARN-7317.v1.patch, YARN-7317.v2.patch > > > When LocalityMulticastAMRMProxyPolicy is splitting up the ANY requests into > different subclusters, we are doing Ceil(N * weight), leading to > overallocation overall. It is better to do Floor(N * weight) for each > subcluster and then assign the residue randomly according to the weights. So > that the total number of containers we ask from all subclusters sum up to be > N. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org