[
https://issues.apache.org/jira/browse/YARN-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17766228#comment-17766228
]
zhengchenyu commented on YARN-10174:
------------------------------------
I think [~youchen] means that we can get weights from job. Then this weights is
used for choose sub cluster.
I think we could add weights in client side.
For example:
There are four sub clusters, In state store, weight is [cluster1:1; cluster2:1,
cluster3:1, cluster4:1], It means the probability of choosing any cluster is 1
* 1 / 4 = 0.25.
If user do not want run app in cluster3, and cluster4, we can set weight
[cluster1:1; cluster2:1, cluster3:0, cluster4:0] in client side. Then the
probability of choosing cluster1 or cluster2 is 1*1 / (1*1 + 1*1 + 1*0 + 1*0)
= 0.5, the probability of choosing cluster3 or cluster4 is 1*0 / (1*1 + 1*1 +
1*0 + 1*0) = 0.
[~elgoiri] [~slfan1989] How about my proposal? Can you give me some advice?
> Add colored policies to enable manual load balancing across sub clusters
> ------------------------------------------------------------------------
>
> Key: YARN-10174
> URL: https://issues.apache.org/jira/browse/YARN-10174
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Young Chen
> Assignee: zhengchenyu
> Priority: Major
>
> Add colored policies to enable manual load balancing across sub clusters
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
