Re: Re: Manually update consumer offset stored in Kafka

2016-10-18 Thread Yuanjia
Yuanjia Li From: Yifan Ying Date: 2016-10-15 01:53 To: users Subject: Re: Manually update consumer offset stored in Kafka Hi Jeff, Could you explain how you send messages to __consumer_offsets to overwrite offsets? Thanks! Yifan On Fri, Oct 14, 2016 at 9:55 AM, Jeff Widman wrote: >

Re: Manually update consumer offset stored in Kafka

2016-10-14 Thread Yifan Ying
Yeah, this works! The consumer API is able to update the consumer offset. The only downside is to stop the real consumers. On Fri, Oct 14, 2016 at 2:47 PM, Kevin A wrote: > I didn't find an off-the-shelf tool to do this when I needed to a few weeks > ago (which was kind of surprising). > > I use

Re: Manually update consumer offset stored in Kafka

2016-10-14 Thread Kevin A
I didn't find an off-the-shelf tool to do this when I needed to a few weeks ago (which was kind of surprising). I used the kafka-python library (my company's wrappers around it, actually) to pretend I was in the consumer group I wanted to update and called commit with the offsets I wanted. First

Re: Manually update consumer offset stored in Kafka

2016-10-14 Thread Yifan Ying
Hi Jeff, Could you explain how you send messages to __consumer_offsets to overwrite offsets? Thanks! Yifan On Fri, Oct 14, 2016 at 9:55 AM, Jeff Widman wrote: > I also would like to know this. > > Is the solution to just use a console producer against the internal topics > that store the offse

Re: Manually update consumer offset stored in Kafka

2016-10-14 Thread Jeff Widman
I also would like to know this. Is the solution to just use a console producer against the internal topics that store the offsets? On Wed, Oct 12, 2016 at 2:26 PM, Yifan Ying wrote: > Hi, > > In old consumers, we use the following command line tool to manually update > offsets stored in zk: > >

Manually update consumer offset stored in Kafka

2016-10-12 Thread Yifan Ying
Hi, In old consumers, we use the following command line tool to manually update offsets stored in zk: *./kafka-run-class.sh kafka.tools.UpdateOffsetsInZK [latest | earliest] [consumer.properties file path] [topic]* But it doesn't work with offsets stored in Kafka. How can I update the Kafka offs