Can ZKStateStore scale for large clusters. Any idea on the number of concurrent jobs that can be supported on top of these ?
Thanks Suma On Wed, Feb 11, 2015 at 1:45 PM, Karthik Kambatla <[email protected]> wrote: > We recommend ZK-store, particularly if you plan to deploy multiple > ResourceManagers with failover. ZK-store ensures a single RM has write > access and thus is better protected against split-brain cases where both > RMs think they are active. > > On Tue, Feb 10, 2015 at 9:59 PM, Suma Shivaprasad < > [email protected]> wrote: > >> We are planning to deploy Hadoop 2.6.0 with a default configuration to >> cache 10000 entries in the state store. With a workload of 150-250 >> concurrent applications at any time , which state store is better to use >> and for what reasons ? >> >> Thanks >> Suma >> > > > > -- > Karthik Kambatla > Software Engineer, Cloudera Inc. > -------------------------------------------- > http://five.sentenc.es > >
