I am using zookeeper for providing HA for spark cluster. We have two nodes zookeeper cluster.
When one of the zookeeper dies then the entire spark cluster goes down . Is this expected behaviour ? Am I missing something in config ? Spark version - 1.6.1. Zookeeper version - 3.4.6 // spark-env.sh SPARK_DAEMON_JAVA_OPTS="-Dspark.deploy.recoveryMode=ZOOKEEPER -Dspark.deploy.zookeeper.url=zk1:2181,zk2:2181" Below is the log from spark master: ZooKeeperLeaderElectionAgent: We have lost leadership 16/06/27 09:39:30 ERROR Master: Leadership has been revoked -- master shutting down. Thanks Vimal
