Re: Where kafka stores consumer offsets in version 0.9.0.0?

2016-09-26 Thread Zhuo Chen
Kaufman, Thanks for your clear and helpful explanation. The article you provided by link is definitely useful about new consumer client, I have fully understood. On Mon, Sep 26, 2016 at 10:36 PM, Kaufman Ng wrote: > Hi Zhuo, > > Since your code uses KafkaConsumer class, it's the "new consumer" i

Re: Where kafka stores consumer offsets in version 0.9.0.0?

2016-09-26 Thread Kaufman Ng
Hi Zhuo, Since your code uses KafkaConsumer class, it's the "new consumer" in Kafka which uses a special kafka topic to keep track of offsets (rather than zookeeper). By default that topic is named "__consumer_offsets". You can use the "kafka-consumer-groups" command to check where the offset is

Where kafka stores consumer offsets in version 0.9.0.0?

2016-09-25 Thread Zhuo Chen
hi, I use kafka 0.9.0.0 in CDH 5.6, and my application consume kafka message by following code. - String topicName = "tpCz01"; Properties props = new Properties();