[
https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672561#comment-16672561
]
Rahul Anand edited comment on YARN-6900 at 11/2/18 4:48 AM:
------------------------------------------------------------
Thanks [~subru] or [~elgoiri] for the comment.
So right now we have two properties in the yarn-site for setting up policy
manager and its related params i.e. *yarn.federation.policy-manager-params* and
*yarn.federation.policy-manager*. According to the code, we should set this
param property with bytes but obviously that is not what user expects. So for
discusstion, first thing is the Format of this input.
Here is how things look is the zknode if I tried to put policy configurations
in statestore for the default queue * using PriorityBroadcastPolicyManager
*get /federationstore/policies/**
{code:java}
*Xorg.apache.hadoop.yarn.server.federation.policies.manager.PriorityBroadcastPolicyManager�{"routerPolicyWeights":{"entry":[{"key":{"id":"cluster-bb"},"value":"1.0"},{"key":{"id":"cluster-ra"},"value":"3.0"}]},"amrmPolicyWeights":null,"headroomAlpha":"0.0"}
{code}
So overall we have these many things to put in the params field
1. routerpolicyweights (weight of particular subcluter to be used for router
policy)
2. amrmpolicyweights (weight of particular subcluter to be used for amrm
policy)
3. headroomAlpha
was (Author: rahulanand90):
Thanks [~subru] or [~elgoiri] for the comment.
So right now we have two properties in the yarn-site for setting up policy
manager and its related params i.e. *yarn.federation.policy-manager-params* and
*yarn.federation.policy-manager*. According to the code, we should set this
param property with bytes but obviously that is not what user expects. So for
discusstion, first thing is the Format of this input.
Here is how things look is the zknode if I tried to put policy configurations
in statestore for the default queue * using PriorityBroadcastPolicyManager
*get /federationstore/policies/**
{code:java}
*Xorg.apache.hadoop.yarn.server.federation.policies.manager.PriorityBroadcastPolicyManager�{"routerPolicyWeights":{"entry":[{"key":{"id":"cluster-bb"},"value":"1.0"},{"key":{"id":"cluster-ra"},"value":"3.0"}]},"amrmPolicyWeights":null,"headroomAlpha":"0.0"}
{code}
So overall we have these many things to put in the params field
1. amrmpolicyweights (weight of particular subcluter to be used for router
policy)
2. routerpolicyweights (weight of particular subcluter to be used for amrm
policy)
3. headroomAlpha
> ZooKeeper based implementation of the FederationStateStore
> ----------------------------------------------------------
>
> Key: YARN-6900
> URL: https://issues.apache.org/jira/browse/YARN-6900
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: federation, nodemanager, resourcemanager
> Reporter: Subru Krishnan
> Assignee: Íñigo Goiri
> Priority: Major
> Fix For: 2.9.0, 3.0.0-beta1
>
> Attachments: YARN-6900-002.patch, YARN-6900-003.patch,
> YARN-6900-004.patch, YARN-6900-005.patch, YARN-6900-006.patch,
> YARN-6900-007.patch, YARN-6900-008.patch, YARN-6900-009.patch,
> YARN-6900-010.patch, YARN-6900-011.patch, YARN-6900-YARN-2915-000.patch,
> YARN-6900-YARN-2915-001.patch
>
>
> YARN-5408 defines the unified {{FederationStateStore}} API. Currently we only
> support SQL based stores, this JIRA tracks adding a ZooKeeper based
> implementation for simplifying deployment as it's already popularly used for
> {{RMStateStore}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
