[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617570#comment-14617570 ]
Carlo Curino commented on YARN-2915: ------------------------------------ [~grey] that is a good questions. We are not designing primarily for cross-DC scenarios but we are of course wondering about whether this approach can handle the latencies/partitioning/general-drama that comes with cross-DC deployment settings. The design is somewhat tolerant to the StateStore being unavailable, but cross-DC settings might stress this beyond its comfort zone. We are planning to run tests for this in the coming weeks/months, and we will report about our findings. > Enable YARN RM scale out via federation using multiple RM's > ----------------------------------------------------------- > > Key: YARN-2915 > URL: https://issues.apache.org/jira/browse/YARN-2915 > Project: Hadoop YARN > Issue Type: New Feature > Components: nodemanager, resourcemanager > Reporter: Sriram Rao > Assignee: Subru Krishnan > Attachments: Yarn_federation_design_v1.pdf > > > This is an umbrella JIRA that proposes to scale out YARN to support large > clusters comprising of tens of thousands of nodes. That is, rather than > limiting a YARN managed cluster to about 4k in size, the proposal is to > enable the YARN managed cluster to be elastically scalable. -- This message was sent by Atlassian JIRA (v6.3.4#6332)