Re: Running Zookeeper on same instance as kafka brokers in multi node cluster

2016-09-19 Thread Craig Swift
Hello, Initially we had our setup with both ZK and Kafka on the same nodes as well. Over time though this proved problematic as we both increased the usage of Kafka and had to scale out the cluster. ZK specifically can be very touchy if it gets IO bound - so when the Kafka cluster would get under

Running Zookeeper on same instance as kafka brokers in multi node cluster

2016-09-19 Thread Digumarthi, Prabhakar Venkata Surya
Hi Team, What are the downsides of installing Zookeeper and kafka on same machine, in multi broker environment? We are trying to install Zookeeper and kafka in AWS world and its becoming difficult for us to maintain ZK and Kafka with some issues. Also re-provisioning ZK and Kafka instances s