[
https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530223#comment-15530223
]
Carlo Curino commented on YARN-5676:
------------------------------------
For very large queue structures, it is convenient to specify a policy for a
subset of the queues (e.g., large/prod queues), and use something like the
{{HashBasedRouterPolicy}} to automatically map all the small to subclusters.
This is better than any of the randomized policies because the mapping between
queue and sub-cluster tends to be more stable, hence there is some better
chance for locality.
I will post the patch soon (testing now).
> Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.
> -----------------------------------------------------------------------
>
> Key: YARN-5676
> URL: https://issues.apache.org/jira/browse/YARN-5676
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager, resourcemanager
> Affects Versions: YARN-2915
> Reporter: Carlo Curino
> Assignee: Carlo Curino
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
