Carlo Curino commented on YARN-2915:

[~grey] that is a good questions. We are not designing primarily for cross-DC 
scenarios but we are of course wondering about whether this approach can handle 
the latencies/partitioning/general-drama that comes with cross-DC deployment 
settings. The design is somewhat tolerant to the StateStore being unavailable, 
but cross-DC settings might stress this beyond its comfort zone.  We are 
planning to run tests for this in the coming weeks/months, and we will report 
about our findings. 

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: Yarn_federation_design_v1.pdf
> This is an umbrella JIRA that proposes to scale out YARN to support large 
> clusters comprising of tens of thousands of nodes.   That is, rather than 
> limiting a YARN managed cluster to about 4k in size, the proposal is to 
> enable the YARN managed cluster to be elastically scalable.  

This message was sent by Atlassian JIRA

Reply via email to