On Wed, May 9, 2012 at 3:18 PM, Mark Grabois <mark.grab...@trendrr.com> wrote: > Hisham, thanks for the advice. Can you elaborate on how you moved the > offset in ZK? I read in the archives some people cleared the offsets > altogether. Did you access the ZK filesystem location where the offsets are > stored: > > /consumers/[group_id]/offsets/[topic]/[broker_id-partition_id] --> > offset_counter_value ((persistent node)
Mark, I've tried both approaches: - deleted the ZK nodes that hold the offsets - reset the value of those nodes to zero Both worked however I stuck with deleting the nodes (since the files represent broker/partition). I can share some of the code if you'd like. hmb. > > > On Tue, May 8, 2012 at 11:20 PM, Hisham Mardam-Bey <his...@mate1inc.com>wrote: > >> Mark, >> >> We have similar needs and have added calls to our code to stop >> consumption, move the offset in ZK, then resume (we use it to go back >> in time). >> >> hmb. >> >> On Sun, May 6, 2012 at 11:36 PM, Mark Grabois <mark.grab...@trendrr.com> >> wrote: >> > Hello, >> > >> > I know the topic of consumer offsets has come up frequently on the list, >> > how it is not possible to control the offset without using >> SimpleConsumer. >> > I would like to be able to reset all consumer offsets to "largest" (so >> that >> > consumption may start with the latest produced messages) when consumption >> > begins to lag behind our data feed. Is there a good way to do it with >> > zookeeper (since we will be using multiple consumers), without restarting >> > consumer? >> > >> > Thank you, >> > Mark >> >> >> >> -- >> Hisham Mardam-Bey >> [ Director of Engineering ] [ Mate1 Inc. ] >> >> A: Because it messes up the order in which people normally read text. >> Q: Why is top-posting such a bad thing? >> A: Top-posting. >> Q: What is the most annoying thing in e-mail? >> >> -=[ Codito Ergo Sum ]=- >> -- Hisham Mardam-Bey [ Director of Engineering ] [ Mate1 Inc. ] A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing in e-mail? -=[ Codito Ergo Sum ]=-
