Botong Huang created YARN-7317:
----------------------------------
Summary: Fix overallocation resulted from ceiling in
LocalityMulticastAMRMProxyPolicy
Key: YARN-7317
URL: https://issues.apache.org/jira/browse/YARN-7317
Project: Hadoop YARN
Issue Type: Task
Reporter: Botong Huang
Assignee: Botong Huang
Priority: Minor
When LocalityMulticastAMRMProxyPolicy is splitting up the ANY requests into
different subclusters, we are doing Ceil(N * weight), leading to overallocation
overall. It is better to do Floor(N * weight) for each subcluster and then
assign the residue randomly according to the weights. So that the total number
of containers we ask from all subclusters sum up to be N.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
