Under zookeeper you should be able to find a /consumers path. I believe this is where the kafka consumers write their offset but I am not 100% sure. This might be the place where all consumers storm/non-storm will be writing their offset so if you have non storm consumers , I would be super cautious before deleting the entire folder.
Thanks Parth On Sep 4, 2014, at 9:14 AM, Kushan Maskey <[email protected]> wrote: > Which zookeeper data do I need to delete? Storm or Kafka? > > -- > Kushan Maskey > 817.403.7500 > > > On Thu, Sep 4, 2014 at 11:01 AM, Vikas Agarwal <[email protected]> wrote: > I guess, you need to empty the zookeeper data directory too. > > > On Thu, Sep 4, 2014 at 9:22 PM, Kushan Maskey > <[email protected]> wrote: > I had to manually flush all the data from kafka. I did that by stopping the > server and deleting the entire content of kafka-logs directory. Then I > restarted kafka again. Then I started my storm. I get following error > message. Because the offset KafkaSpout is looking for is at 81573 and kafka > offset is at 0 right now. How do i resolve this problem? > > kafka.common.OffsetOutOfRangeException: Request for offset 81573 but we only > have log segments in the range 0 to 0. > > at kafka.log.Log.read(Log.scala:380) > > at > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:530) > > at > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:476) > > at > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:471) > > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > at > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:471) > > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:437) > > at kafka.server.KafkaApis.handle(KafkaApis.scala:186) > > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > at java.lang.Thread.run(Thread.java:744) > > [2014-09-04 15:35:25,904] ERROR [KafkaApi-0] Error when processing fetch > request for partition [1002,0] offset 8430 from consumer with correlation id > 0 (kafka.server.KafkaApis) > > kafka.common.OffsetOutOfRangeException: Request for offset 8430 but we only > have log segments in the range 0 to 0. > > at kafka.log.Log.read(Log.scala:380) > > at > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:530) > > at > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:476) > > at > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:471) > > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > at > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:471) > > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:437) > > at kafka.server.KafkaApis.handle(KafkaApis.scala:186) > > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > at java.lang.Thread.run(Thread.java:744) > > -- > Kushan Maskey > > > > > -- > Regards, > Vikas Agarwal > 91 – 9928301411 > > InfoObjects, Inc. > Execution Matters > http://www.infoobjects.com > 2041 Mission College Boulevard, #280 > Santa Clara, CA 95054 > +1 (408) 988-2000 Work > +1 (408) 716-2726 Fax > > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
