Re: How many spark masters and do I need to tolerate one failure in one DC and two AZ?

2017-01-24 Thread kant kodali
I think I made a mistake...I would need at least N/2 + 1 nodes available all the time to reach quorum and be able do leader election within zookeeper ensemble Given that I don't know ahead of time which availability zone is going to go down I guess I cant really tolerate one AZ going down within t

How many spark masters and do I need to tolerate one failure in one DC and two AZ?

2017-01-24 Thread kant kodali
How many spark masters and zookeeper servers do I need to tolerate one failure in one DC that has two availability zones ? Note: The one failure that I want to tolerate can be in either availability zone. Here is my understanding so far. please correct me If I am wrong? for Zookeeper I would need