Hi guys Today we have just one datacenter with a few NiFi clusters, so we use a dedicated 3-node zookeeper cluster in that datacenter. We are now planning to expand to another datacenter, so we would like to split the NiFi nodes as well as zookeeper nodes to the two datacenters. However 2 zookeeper nodes is not a good quorum number, so we had the idea to do the following regarding zookeeper:
* Datacenter 1: 2 zookeeper nodes * Datacenter 2: 2 zookeeper nodes * Location 3 (another small DC): 1 zookeper node -> no NiFis All locations are connected via dark fiber, however the third location is bit more far away from the others (everything withing 100km). Now, as we anyway split the NiFi clusters over the two datacenters. Shall we limit the NiFi zookeeper client (state-management.xml) to the zookeeper nodes located within the same datacenter? Any comments to our design idea? What’s the best way to configure zookeeper clients in a way that local (same datacenter) zookeepers are preferred? Any other ideas how we should configure this related to zookeeper? Shall we use just one zookeeper per location and distribute the load over all 3 nodes/datacenters evenly? This would then cause load between the datacenters under normal circumstances… Cheers Josef
smime.p7s
Description: S/MIME Cryptographic Signature
