The only way i know to do this is to use mesos with zookeepers. you specify zookeeper url as spark url that contains multiple zookeeper hosts. Multiple mesos masters are then elected thru zookeeper leader election until current leader dies; at which point mesos will elect another master (if still left).
iirc, in this mode spark master never runs, only master slaves are being spun by mesos slaves directly. On Wed, Apr 9, 2014 at 3:08 PM, Pradeep Ch <pradeep.chanum...@gmail.com>wrote: > Hi, > > I want to enable Spark Master HA in spark. Documentation specifies that we > can do this with the help of Zookeepers. But what I am worried is how to > configure one master with the other and similarly how do workers know that > the have two masters? where do you specify the multi-master information? > > Thanks for the help. > > Thanks, > Pradeep >
