Hi,
Spark standalone mode does not use or rely on ZooKeeper by default. The
Spark master and workers communicate directly with each other without using
ZooKeeper. However, it appears that in your case you are relying on
ZooKeeper to provide high availability for your standalone cluster. By
configu
Looking at Master.scala, I don't see code that would bring master back up
automatically.
Probably you can implement monitoring tool so that you get some alert when
master goes down.
e.g.
http://stackoverflow.com/questions/12896998/how-to-set-up-alerts-on-ganglia
More experienced users may have be
Hi Ted,
Thanks for the pointers. I had a three node zookeeper setup . Now the
master alone dies when a zookeeper instance is down and a new master is
elected as leader and the cluster is up.
But the master that was down , never comes up.
Is this the expected ? Is there a way to get alert when a
Please see some blog w.r.t. the number of nodes in the quorum:
http://stackoverflow.com/questions/13022244/zookeeper-reliability-three-versus-five-nodes
http://www.ibm.com/developerworks/library/bd-zookeeper/
the paragraph starting with 'A quorum is represented by a strict majority
of nodes'
F
