Re: Offset Management in Kafka

This might help : https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka http://www.slideshare.net/jjkoshy/offset-management-in-kafka Thanks, Mayuresh On Thu, Oct 15, 2015 at 5:39 AM, Kiran Singh wrote: > Hi > > I am

Re: offset-management-in-kafka

You are looking at the newer, and not-ready-yet consumer there. The configuration you are looking for is defined here: core/src/main/scala/kafka/consumer/ConsumerConfig.scala Gwen On Wed, Apr 8, 2015 at 9:25 AM, Yosi Botzer yosi.bot...@gmail.com wrote: Hi, I am looking at the java class

Re: offset-management-in-kafka

This is available from 0.8.2.0, and is enabled on server by default. The consumer needs to specify offsets.storage parameter - the default is still zookeeper, so the consumers should set it to 'kafka'. The documentation also explain how to migrate from zookeeper offsets to kafka offsets. Gwen

Re: offset-management-in-kafka

Thanks Gwan, Are there any plans to change the default from zookeeper to kafka in the future? On Wed, Apr 8, 2015 at 6:29 PM, Gwen Shapira gshap...@cloudera.com wrote: This is available from 0.8.2.0, and is enabled on server by default. The consumer needs to specify offsets.storage parameter