[
https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388325#comment-16388325
]
Carlo Curino commented on YARN-7953:
------------------------------------
[~asuresh] I like this suggestion, and from our offline convo I know you are
looking into it, please let me know if it looks promising once you tested the
ideas.
Since the FederationQueue objects I have here are transformed in YARN-7403 and
YARN-7834 in other objects for algorithmic calculations,
this should be pretty doable in terms of the rest of the YARN-7402 work items.
Small caveats:
# The reason I had initially not used QueueMetrics is that I saw them being
broken/off often in live clusters, so I thought they were maintained a bit
sloppily.
If we can assure they are correct and consistent I think it is good to have
them.
# Also we should validate whether the polling of QueueMetrics is for
performance (might be better due to already maintained objects and the delta
protocol,
but want to make sure).
# The other advantage of the FedQueue objects was the fact that were very easy
to build tests by constructing scenarios in .json. If we can do
the same for QueueMetrics and the alike, I think it should be good.
> [GQ] Data structures for federation global queues calculations
> --------------------------------------------------------------
>
> Key: YARN-7953
> URL: https://issues.apache.org/jira/browse/YARN-7953
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Carlo Curino
> Assignee: Carlo Curino
> Priority: Major
> Attachments: YARN-7953.v1.patch
>
>
> This Jira tracks data structures and helper classes used by the core
> algorithms of YARN-7402 umbrella Jira (currently YARN-7403, and YARN-7834).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
