[ https://issues.apache.org/jira/browse/HBASE-11165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123674#comment-14123674 ]
Andrew Purtell commented on HBASE-11165: ---------------------------------------- bq. It seems like everyone is rushing to following the example of HDFS to federation (that's what split meta, split masters gets us). I'm concerned about this notion of a split meta colocated with a split master function also. Split meta on its own is one thing. Also splitting the master as described smacks of the dynamic subtree partitioning of Ceph's MDS, which has never been stable at scale as far as I know, and there's no stability in sight there either. > Scaling so cluster can host 1M regions and beyond (50M regions?) > ---------------------------------------------------------------- > > Key: HBASE-11165 > URL: https://issues.apache.org/jira/browse/HBASE-11165 > Project: HBase > Issue Type: Brainstorming > Reporter: stack > Attachments: HBASE-11165.zip, Region Scalability test.pdf, > zk_less_assignment_comparison_2.pdf > > > This discussion issue comes out of "Co-locate Meta And Master HBASE-10569" > and comments on the doc posted there. > A user -- our Francis Liu -- needs to be able to scale a cluster to do 1M > regions maybe even 50M later. This issue is about discussing how we will do > that (or if not 50M on a cluster, how otherwise we can attain same end). > More detail to follow. -- This message was sent by Atlassian JIRA (v6.3.4#6332)