Hisham, thanks for the advice. Can you elaborate on how you moved the offset in ZK? I read in the archives some people cleared the offsets altogether. Did you access the ZK filesystem location where the offsets are stored:
/consumers/[group_id]/offsets/[topic]/[broker_id-partition_id] --> offset_counter_value ((persistent node) On Tue, May 8, 2012 at 11:20 PM, Hisham Mardam-Bey <his...@mate1inc.com>wrote: > Mark, > > We have similar needs and have added calls to our code to stop > consumption, move the offset in ZK, then resume (we use it to go back > in time). > > hmb. > > On Sun, May 6, 2012 at 11:36 PM, Mark Grabois <mark.grab...@trendrr.com> > wrote: > > Hello, > > > > I know the topic of consumer offsets has come up frequently on the list, > > how it is not possible to control the offset without using > SimpleConsumer. > > I would like to be able to reset all consumer offsets to "largest" (so > that > > consumption may start with the latest produced messages) when consumption > > begins to lag behind our data feed. Is there a good way to do it with > > zookeeper (since we will be using multiple consumers), without restarting > > consumer? > > > > Thank you, > > Mark > > > > -- > Hisham Mardam-Bey > [ Director of Engineering ] [ Mate1 Inc. ] > > A: Because it messes up the order in which people normally read text. > Q: Why is top-posting such a bad thing? > A: Top-posting. > Q: What is the most annoying thing in e-mail? > > -=[ Codito Ergo Sum ]=- >
