Thanks guys. Based on the responses it looks like I need to have a tool of
my own to read offsets.
On Mon, Apr 13, 2015 at 3:07 PM, Jiangjie Qin j...@linkedin.com.invalid
wrote:
Yeah, the current ConsumerOffsetChecker has this issue (maybe bug also) if
the offset storage is Kafka and no offset
Hi Vamsi,
You can also see the example here
https://github.com/madhukarbharti/kafka-8.2.1-test/blob/master/src/com/bharti/kafka/offset/OffsetHandler.java
if
you want to use Java API to get the offset from topic.
Regards,
Madhukar
On Mon, Apr 13, 2015 at 10:25 PM, 4mayank 4may...@gmail.com
Yeah, the current ConsumerOffsetChecker has this issue (maybe bug also) if
the offset storage is Kafka and no offset has been committed. It will
throw ZK exception, which is very confusing. KAFKA-1951 was opened for
this but was not checked in.
Thanks.
Jiangjie (Becket) Qin
On 4/13/15, 9:55 AM,
I did a similar change - moved from High Level Consumer to Simple Consumer.
Howerver kafka-consumer-offset-checker.sh throws an exception. Its
searching the zk path /consumers/group/ which does not exist on any of my
zk nodes.
Is there any other tool for getting the offset lag when using Simple
Hi,
We are using 0.8.2.1 currently.
- How to get the consumer offsets from the offsets topic?
- Is there any built-in function which I could use? (like in
AdminUtils.scala)
- Is it ok to start a simple consumer and read the offsets from the topic?
We used to read the offsets from zookeeper
Hi Vamsi,
The ConsumerOffsetChecker.scala or kafka-consumer-offset-checker.sh still
works. You can use them to check the offsets.
If you need to check the offsets programmatically, you can send
OffsetsFetcheRequest to broker using simple consumer. You may refer the
ConsumerOffsetChecker.scala to
