I am not sure how your plugin works. Does it use SimpleConsumer or the high level consumer? Which version of Kafka is it on?
Thanks, Jun On Mon, Feb 24, 2014 at 12:28 PM, Krishna Raj <[email protected]>wrote: > Hi Jun, > > I have exactly 2 messages when I run the console consumer. I am totally > confused why my API Consumer looks for 1318 offset. > > Any help is greatly appreciated ! > > Thanks, > KR > > > On Mon, Feb 24, 2014 at 7:37 AM, Jun Rao <[email protected]> wrote: > > > The following log says there are only 2 messages in the log. > > > > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we > only > > have log segments in the range 0 to 2. > > > > If you run console consumer on that topic (using --from-beginning), how > > many messages do you see? > > > > Thanks, > > > > Jun > > > > > > On Mon, Feb 24, 2014 at 2:17 AM, Krishna Raj <[email protected] > > >wrote: > > > > > Hi there, > > > > > > I am a newbie to Kafka. I am trying to use the ( > > > https://github.com/endgameinc/elasticsearch-river-kafka) plugin to > pull > > > the > > > messages from Kafka. > > > > > > When I start the ElasticSearch, the 1st message gets pulled into the > > > cluster. And after no messages are pulled even there are enough > messages > > > available. > > > > > > I see the below exception continuously in kafka server log. Any > > information > > > is greatly appreciated. > > > > > > Thanks ! > > > > > > > > > [2014-02-24 02:12:20,832] ERROR [KafkaApi-0] Error when processing > fetch > > > request for partition [asdaGro,0] offset 1318 from consumer with > > > correlation id 0 (kafka.server.KafkaApis) > > > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we > > only > > > have log segments in the range 0 to 2. > > > at kafka.log.Log.read(Log.scala:429) > > > at > > > > > > > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388) > > > at > > > > > > > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334) > > > at > > > > > > > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330) > > > at > > > > > > > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > > at > > > > > > > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > > at > > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > > at > > > > > > > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330) > > > at > kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296) > > > at kafka.server.KafkaApis.handle(KafkaApis.scala:66) > > > at > > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > > at java.lang.Thread.run(Thread.java:724) > > > [2014-02-24 02:12:21,833] ERROR [KafkaApi-0] Error when processing > fetch > > > request for partition [asdaGro,0] offset 1318 from consumer with > > > correlation id 0 (kafka.server.KafkaApis) > > > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we > > only > > > have log segments in the range 0 to 2. > > > at kafka.log.Log.read(Log.scala:429) > > > at > > > > > > > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388) > > > at > > > > > > > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334) > > > at > > > > > > > > > kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330) > > > at > > > > > > > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > > at > > > > > > > > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) > > > at > > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > > > at scala.collection.immutable.Map$Map1.map(Map.scala:93) > > > at > > > > > > > > > kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330) > > > at > kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296) > > > at kafka.server.KafkaApis.handle(KafkaApis.scala:66) > > > at > > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > > > at java.lang.Thread.run(Thread.java:724) > > > > > >
