Thanks guys. I am able to reset kafka successfully. But the storm still looking for the older offsets. How to reset storm offsets now?
-- Kushan Maskey 817.403.7500 On Thu, Sep 4, 2014 at 11:42 AM, Nick Beenham <[email protected]> wrote: > I had this same issue yesterday, only solution was to shut everything down > and clean out the zookeeper, start it all up again. > > > On Thu, Sep 4, 2014 at 12:39 PM, Parth Brahmbhatt < > [email protected]> wrote: > >> Under zookeeper you should be able to find a /consumers path. I believe >> this is where the kafka consumers write their offset but I am not 100% sure. >> This might be the place where all consumers storm/non-storm will be >> writing their offset so if you have non storm consumers , I would be super >> cautious before deleting the entire folder. >> >> Thanks >> Parth >> >> >> >> On Sep 4, 2014, at 9:14 AM, Kushan Maskey < >> [email protected]> wrote: >> >> Which zookeeper data do I need to delete? Storm or Kafka? >> >> -- >> Kushan Maskey >> 817.403.7500 >> >> >> On Thu, Sep 4, 2014 at 11:01 AM, Vikas Agarwal <[email protected]> >> wrote: >> >>> I guess, you need to empty the zookeeper data directory too. >>> >>> >>> On Thu, Sep 4, 2014 at 9:22 PM, Kushan Maskey < >>> [email protected]> wrote: >>> >>>> I had to manually flush all the data from kafka. I did that by stopping >>>> the server and deleting the entire content of kafka-logs directory. Then I >>>> restarted kafka again. Then I started my storm. I get following error >>>> message. Because the offset KafkaSpout is looking for is at 81573 and kafka >>>> offset is at 0 right now. How do i resolve this problem? >>>> >>>> kafka.common.OffsetOutOfRangeException: Request for offset 81573 but we >>>> only have log segments in the range 0 to 0. >>>> >>>> at kafka.log.Log.read(Log.scala:380) >>>> >>>> at >>>> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:530) >>>> >>>> at >>>> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:476) >>>> >>>> at >>>> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:471) >>>> >>>> at >>>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) >>>> >>>> at >>>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) >>>> >>>> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) >>>> >>>> at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) >>>> >>>> at scala.collection.immutable.Map$Map1.map(Map.scala:93) >>>> >>>> at >>>> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:471) >>>> >>>> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:437) >>>> >>>> at kafka.server.KafkaApis.handle(KafkaApis.scala:186) >>>> >>>> at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) >>>> >>>> at java.lang.Thread.run(Thread.java:744) >>>> >>>> [2014-09-04 15:35:25,904] ERROR [KafkaApi-0] Error when processing >>>> fetch request for partition [1002,0] offset 8430 from consumer with >>>> correlation id 0 (kafka.server.KafkaApis) >>>> >>>> kafka.common.OffsetOutOfRangeException: Request for offset 8430 but we >>>> only have log segments in the range 0 to 0. >>>> >>>> at kafka.log.Log.read(Log.scala:380) >>>> >>>> at >>>> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:530) >>>> >>>> at >>>> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:476) >>>> >>>> at >>>> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:471) >>>> >>>> at >>>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) >>>> >>>> at >>>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) >>>> >>>> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) >>>> >>>> at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) >>>> >>>> at scala.collection.immutable.Map$Map1.map(Map.scala:93) >>>> >>>> at >>>> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:471) >>>> >>>> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:437) >>>> >>>> at kafka.server.KafkaApis.handle(KafkaApis.scala:186) >>>> >>>> at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) >>>> >>>> at java.lang.Thread.run(Thread.java:744) >>>> -- >>>> Kushan Maskey >>>> >>>> >>> >>> >>> -- >>> Regards, >>> Vikas Agarwal >>> 91 – 9928301411 >>> >>> InfoObjects, Inc. >>> Execution Matters >>> http://www.infoobjects.com >>> 2041 Mission College Boulevard, #280 >>> Santa Clara, CA 95054 >>> +1 (408) 988-2000 Work >>> +1 (408) 716-2726 Fax >>> >>> >> >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > >
