Re: offsets.storage=kafka, dual.commit.enabled=false still requires ZK

2015-06-10 Thread Shady Xu
Looking forward to the 0.8.3 release. BTW, some official management consoles should be better. Non of the ones mentioned on the official website rocks. 2015-06-10 2:38 GMT+08:00 Ewen Cheslack-Postava e...@confluent.io: The new consumer implementation, which should be included in 0.8.3, only

Re: offsets.storage=kafka, dual.commit.enabled=false still requires ZK

2015-06-09 Thread Gwen Shapira
The existing consumer uses Zookeeper both to commit offsets and to assign partitions to different consumers and threads in the same consumer group. While offsets can be committed to Kafka in 0.8.2 releases, which greatly reduces the load on Zookeeper, the consumer still requires Zookeeper to

Re: offsets.storage=kafka, dual.commit.enabled=false still requires ZK

2015-06-09 Thread Ewen Cheslack-Postava
The new consumer implementation, which should be included in 0.8.3, only needs a bootstrap.servers setting and does not use a zookeeper connection. On Tue, Jun 9, 2015 at 1:26 PM, noah iamn...@gmail.com wrote: We are setting up a new Kafka project (0.8.2.1) and are trying to go straight to