Carlo Curino commented on YARN-7953:

[~asuresh] I like this suggestion, and from our offline convo I know you are 
looking into it, please let me know if it looks promising once you tested the 

Since the FederationQueue objects I have here are transformed in YARN-7403 and 
YARN-7834 in other objects for algorithmic calculations, 
 this should be pretty doable in terms of the rest of the YARN-7402 work items.

Small caveats:
 # The reason I had initially not used QueueMetrics is that I saw them being 
broken/off often in live clusters, so I thought they were maintained a bit 
 If we can assure they are correct and consistent I think it is good to have 
 # Also we should validate whether the polling of QueueMetrics is for 
performance (might be better due to already maintained objects and the delta 
 but want to make sure).
 # The other advantage of the FedQueue objects was the fact that were very easy 
to build tests by constructing scenarios in .json. If we can do
 the same for QueueMetrics and the alike, I think it should be good.

> [GQ] Data structures for federation global queues calculations
> --------------------------------------------------------------
>                 Key: YARN-7953
>                 URL: https://issues.apache.org/jira/browse/YARN-7953
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>            Priority: Major
>         Attachments: YARN-7953.v1.patch
> This Jira tracks data structures and helper classes used by the core 
> algorithms of YARN-7402 umbrella Jira (currently YARN-7403, and YARN-7834).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to