[
https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380907#comment-15380907
]
Carlo Curino commented on YARN-5323:
------------------------------------
This initial patch presents the APIs for policies (implementations in
YARN-5324, YARN-5325). The key philosophy of our design is to:
# have a very opaque format in the federation store, so that we can evolve
policy freely (likely to happen as we experience with this). To assist with
this though, we foresee each {{FederationPolicy}} to implement the
{{FederationPolicyWriter}} interface that allows us to control the entire
lifecycle of a policy. The envisioned usage is: 1) a {{FederationPolicy}} is
instantiated as part of the admin tools, and configure by setting all sort of
configs in it (which might change drastically as policies get more
sophisticated), 2) the admin tools invoke {{serialize()}} and get a
{{FederationPolicyConfiguration}} out of it that is stored in the policy store,
3) on the router/amrmproxy side this is fetched, a FederationPolicy object is
instantiated, and via the {{FederationPolicyConfigurator}} apis the
{{RouterPolicy}} and {{AMRMProxyFederationPolicy}} are instantiated and
initialized.
# Note that we actively want to bind together the choice of
{{AMRMProxyFederationPolicy}} and {{RouterPolicy}}, which must be coordinated
to operate correctly. As such the {{FederationPolicyConfigurator}} is a way to
raise the bar for a misconfiguration (one needs to write a class that
mistakenly combines to policies, instead of just mistyping a conf). This also
allows to do consistency checks among the configurations of the two policies.
> Policies APIs (for Router and AMRMProxy policies)
> -------------------------------------------------
>
> Key: YARN-5323
> URL: https://issues.apache.org/jira/browse/YARN-5323
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager, resourcemanager
> Reporter: Carlo Curino
> Assignee: Carlo Curino
> Attachments: YARN-5323.01.patch
>
>
> This JIRA tracks APIs for the policies that will guide the Router and
> AMRMProxy decisions on where to fwd the jobs submission/query requests as
> well as ResourceRequests.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
