RE: Kafka/Zookeeper deployment Questions

2014-10-17 Thread Sybrandy, Casey
Neha, Thanks. I'd still love to know if anyone has used Consul and/or Confd to manage a cluster. Casey From: Neha Narkhede [neha.narkh...@gmail.com] Sent: Thursday, October 16, 2014 9:54 AM To: users@kafka.apache.org Subject: Re: Kafka/Zookeeper

Re: Kafka/Zookeeper deployment Questions

2014-10-17 Thread Roger Hoover
a cluster. Casey From: Neha Narkhede [neha.narkh...@gmail.com] Sent: Thursday, October 16, 2014 9:54 AM To: users@kafka.apache.org Subject: Re: Kafka/Zookeeper deployment Questions In other words, if I change the number of partitions, can I restart

RE: Kafka/Zookeeper deployment Questions

2014-10-17 Thread Sybrandy, Casey
To: users@kafka.apache.org Subject: Re: Kafka/Zookeeper deployment Questions Casey, Could you describe a little more about how these would help manage a cluster? My understanding is that Consul provides service discovery and leader election. Kafka already uses ZooKeeper for brokers to discover each

Re: Kafka/Zookeeper deployment Questions

2014-10-17 Thread Roger Hoover
what works and what doesn't. ___ From: Roger Hoover [roger.hoo...@gmail.com] Sent: Friday, October 17, 2014 12:26 PM To: users@kafka.apache.org Subject: Re: Kafka/Zookeeper deployment Questions Casey, Could you describe a little more about how these would

Re: Kafka/Zookeeper deployment Questions

2014-10-16 Thread Neha Narkhede
In other words, if I change the number of partitions, can I restart the brokers one at a time so that I can continue processing data? Changing the # of partitions is an online operation and doesn't require restarting the brokers. However, any other configuration (with the exception of a few

Kafka/Zookeeper deployment Questions

2014-10-15 Thread Sybrandy, Casey
Hello, We're looking into deploying Kafka and Zookeeper into an environment where we want things to be as easy to stand up and administer. To do this, we're looking into using Consul, or similar, and Confd to try to make this as automatic as possible. I was wondering if anyone had an